I'm right there with you for every reason you listed. Here's an anecdote from the last week when my mother visited:

In NYC, the buses are equipped with devices to accept change as a fare. Also, the metrocard machines support the use of cash to purchase said card. Now, there is a special bus that runs from LaGuardia into Manhattan upto Colombia University area called the M60.

When she arrived in the city this last time, apparently, the MTA has removed the ability to board the M60 via change payment. Instead, you must purchase a special pass from a machine inside (there's nothing wrong with that).

The problem? That machine accepts cards and only cards. So if you wanted to use that method of public transport, you have no choice but to use a credit/debit card. Thankfully, taxis accept cash however, that is an expense closer to $40 than the $5 to use public transport which does not have the appearance of being fair to anyone at all.

Also, I have very little trust in the current social constructs and do not like the idea of having every single purchase I make recorded and distributed to advertisers and other not-so-nice government agencies for furthering questionable agendas of individuals within said organizations.

I do not like the argument of "but it's so convenient and why not? It's not like I can be harmed." because it always opens up the door for exactly that. I just think us so called residents of the 1st world really really really need to start evaluating our reasons for creating the things that we do beyond "we can afford it and it makes me temporarily happy."

*edited because wall of text