I did most of my growing up in the 70s, when telephones were a mysterious and interesting thing and long distance calls were expensive.
I remember the early bag-brick cell phones (I had a friend who used to ostentatiously put his on the table in restaurants so everyone could see it) and I remember how unreliable the early cell technology was. Around the same time, I was expanding my life into networking – in 1981 I was the “mjr” on the internet, until Marcia J. R. at the Wilmer Eye Clinic also started using that, and I emailed her (naturally) and asked her to stop. Johns Hopkins had internet connections (except then it was ARPANET) because of its military research at the Applied Physics Laboratory (nuclear weapons) and its long relationship with Aberdeen Proving Ground. So, when I discovered email, it was a magical thing: fast, mostly reliable, simple. It worked and kept on working ever since.
At my first job, I missed ARPANET access and arranged to set up a uucp connection to University of Maryland, that we also ran ‘B’ news over – the USENET bulletin board/broadcast system. That was a bit less reliable than ARPANET: uucp messages got transmitted over the blazing fast 4800baud modem that we had assigned for the task (a Telebit Trailblazer, capable of 19.2K if it was talking to one of its kin, which it was, but for compressed traffic it was really 4800baud) – but the email worked. I could email one of my friends who worked at UMD, “hey, anyone for lunch?” and the message would get there in time for us all to get to the designated food place, in time. It was mostly reliable, though sometimes there would be mysterious break-downs and a system administrator (i.e.: me) would have to figure out what was jamming the queue and burp and clean things up. “Jamming” could be as simple as the time when a researcher tried to send a file that was an entire megabyte and everything ground to a halt, or it could be as complicated as the discovery that Telebit Trailblazers would hang up the connection if you sent an email containing:
ATH
on a line by itself. I’m sure at least one of you remembers that: that’s the Hayes modem instruction to “hang up” – it’s supposed to disconnect the modem if the modem sees that in the command channel not the data channel; Telebit had to send everyone a firmware update, which involved plugging the modem into a PC and running a special program to download new firmware to the modem.
But, it all mostly worked. It was reliable enough that you could schedule lunch or (as I did) make friends online and even marry one of them (as I did) I’m tempted to argue that if a technology is not reliable enough to flirt over, humans will find something else, because the flirt must go through. But I’m not sure if that’s true; I am imagining an ancient Roman flirtation involving slaves running back and forth across the Palatine, sweating and cursing under their breath – they carry news that must get through.
My first pager came in 1985; I was “on call” at a major hospital’s data center and we had a rotational pager that one of the systems administrators had to take home each night, in case the paper roll into the printer jammed, or something really dramatic happened. Mostly, though, things worked. But I recall, at the time, thinking that the pager had its own completely different feed-architecture that got the data moved around, and that was redundant – it ought to be collapsed to a common mechanism with special cases for applications built atop it. I guess it was around 1987 or 1988 that I was starting to think architecturally. I was growing annoyed that there were so many ways of doing the same thing, basically, each of which had its own separate legerdemain* – things had not exploded, yet, which happened in 1991/1992 when browsers hit the scene. Ah, browsers! Remarkably bandwidth-inefficient, badly-coded applications, with a host of embedded security flaws in their design (the idea of having your machine render someone else’s data safely is fundamentally stupid). And the explosion that followed was interesting to live through.
Do you remember where you were on August 9, 1995? I do. I was in the Dallas, TX, data center of Sterling Software working on a consulting gig with Kent L., and there was a big monitor with CNN showing the ticker for Netscape, which had gone public that morning. As Netscape’s stock screamed up and up, Kent said, “looks like the beginning of a bubble” and I said, “it’s beta-test code. That whole thing is based on beta-test code! This is crazy!” Kent said, “everything will change.” He was right; that was the beginning of what I call “the endless beta-test”: reliability and predictability mean nothing compared to size of user base and shoveling buggy feature-sets out the door. I thought, at the time, that having systems that were good mattered; what really mattered was having systems that were big and ubiquitous. (I still think Facebook looks like shit, btw)
That was the shot below the waterline for systems architectures. Since features and user base were the new coin, there was nothing discouraging vendors from dividing the market so as to conquer corners of it. That’s how and why we wound up with AOL instant messenger, that couldn’t talk to Netscape instant message, which couldn’t talk to email (which was fast and reliable enough that it could have served as a common routing architecture for those messages, etc) – system architecture was dead. The lurking miasma that was about to come and kill systems, period, hadn’t metastasized, yet. But it was starting.
I’m referring, of course, to spam. Because there was no system architecture, there was a plethora of different ‘solutions’ and spammers were able to attack the weakest links in an attempt to get through their very important messages. Between 1992 and 1996, spam erupted to become most of what the internet was. That probably seems like a broad claim, because most of us now live behind barriers of spam filters with sort of mostly work with around 95% accuracy. Which means that they’re wrong 1 in 20 times (unless they are trained constantly) But the statistics horrified me in 1999 when I looked at them: 99% of internet email traffic was spam. 99% of internet traffic in total was banner ads and – with the arrival of horribly stupid ideas like javascript and Flash and ActiveX – (the idea of having your machine render someone else’s data safely is fundamentally stupid) – since there was no sensibly architected point at which to inject whitelisting controls, the internet became a mess of spam filters, everywhere.
Today I carry around an expensive supercomputer that’s light, wafer-thin, and connects to the internet via one or two kludgy mechanisms that are designed not to be good, but to enable my activity to be captured either by Apple or Verizon and shared with their marketing partners or the FBI. My supercomputer runs shitty application protocols, none of which have a sensible architecture, which are designed to track my activity and sell traces of potentially economic interest to Amazon, or Google or whoever is selling fucking spam. What I am saying is that spammers won the internet: the entire system has been built and re-built to carry their useless bullshit. If you think about the fact that 95% of the internet is spam and banner ads, you cannot avoid the conclusion that we’d have 19 times more available bandwidth if we just got rid of that crap, entirely. The same applies to our CPUs in our devices – CPUs that are running badly coded inefficient subroutines embedded in the apps we run, that track our dwell time on images, and report back to marketers. I have an app that exists as a call-out in my phone’s browser, that pre-parses every bit of HTML that my phone gets, so it can edit out spam – oh, boy, I bet that’s fucking fast if I didn’t have goddamn supercomputer to throw at it – and, what a stupid, stupid architecture: get the data, hand it off, then read it back and render it for the user. It gets even better when (depending on your anti-spam architecture) it hits a page that hasn’t been seen before, and ships the HTML off to a cloud server somewhere, that scrubs it and updates the AI’s knowledge-base, then reads it back – however many trips back and forth across the network, so you can avoid having the internet work the way the assholes at Google and Facebook and whatnot want it to work.
And, if you are too successful at avoiding the bullshit, they’ll just hold the internet hostage, for you, until you turn your anti-spam off. The current trend among stupid sites (including some of the big ones) is that they’ll try to guilt trip you if you’re running an ad blocker. They decided on a fundamentally stupid business model (“hey lets give all our publication away and just ask people to throw money at us!”) and they want to guilt trip you or hold your internet hostage until you read their useless bullshit. No, I don’t want to refinance. No, I do not need children’s daycare, I don’t even have kids. Yes, I know your ads would be better “targeted” if I looked at all of them but instead I am sitting here thinking “I know why those ISIS guys get mad enough at modern civilization that they throw people off buildings.” It’s extreme but it’s an important message, too.
So, I watched messaging (email, txt, cell phones, etc) bloom from a bunch of small technologies that mostly barely worked into massively successful technologies that mostly barely work. Here, where I live, it’s Verizon country and I can’t get broadband that isn’t mind-blowingly expensive because the FCC has decided that they can trust Verizon not to gouge me if they have a bandwidth monopoly. Last night my internet went out twice – which is uncommonly shitty for the $280+/month I pay for it. Today, my email (which is hosted at a cloud hosting service) blew up and I can’t reach support because: email is down. The other day I replied to a message on the FTB super secret backchannel and it bounced because Google apparently decided that maybe I am a spammer, after all. I’ve only been using this account (and never sent spam, I swear!) for 20 years but I can’t expect an AI that was trained yesterday to understand that. We, the collected nerds of the world, built a system that is massive and fast but unreliable and full of garbage when, if we had built a system that was well-architected and appropriately layered would not need to be anywhere near as massive or fast or expensive.
Meanwhile, I never answer my land line and my cell phone gets 2 or 3 “unknown caller” calls a day. Both of those systems have substantially lost their usefulness for me. I know Verizon could track the unknown callers, but the fact is that the unknown spam callers are more important to Verizon’s bottom line than I am. And, since “social media” has the same problem – it’s a conduit for ads – it is structurally impossible to make it anything but garbage; it’s supposed to be garbage and it will always be. I struggle to keep email useful but I wonder if it’s worth the battle. I don’t answer my phone or check the messages, and I throw 90% of my surface mail away. What a brave new world of shit marketing people have built for us!
Anyway, if you try to email me and don’t get a reply it’s because my replies are bouncing.
Rob Pike, back in the late 80s, said “distributed computing is when a system you’ve never heard of before is able to take you offline.” Back in the 80s, when I hear that, I thought, “damn, skippy, Rob!” But last time I checked, Rob’s working for Google, which is the ultimate instance of that distributed glarp-wad young Pike was warning about.
*Legerdemain, from the ancient French, literally “light handedness” or “light touch”
PS – you kids get offa my lawn. Oh, wait, sorry, those are cows. Never mind.
komarov says
I dimly recall the FCC head guy used to be a business guy. So if he banks on trust he no doubt knows what he’s doing. Also, 280$ a month? I’d assume that to be a typo except I keep hearing wondrous things about US internet pricing. Do they at least retask a satellite just for you? Does your router have solid-gold heat sinks and radiator fins? Are the cables (also high-carat gold, naturally) hand-insulated on the thighs of geeks? That almost tops my annual bill, and I get unlimited volume, decent speed and reliability I don’t have to think about. Just no gold components, although perhaps I should check.
The rest of the things you decry seem to be capitalism in action. When the netscape guys got rich presumably that was a signal everything was good enough. That’d be my reaction if everybody started showing up with money at my door. I’d probably have very strong feelings about “never interfering with a running system” if said system is running to fill my coffers.
Your well-built, well-policed system would also wipe out the ad, ad-distribution, spam, spam-blocking, fraud, and fraud-protection industries, not to mention the Nigerian royal family, who at the very least would find themselves cut off from the rest of the world. Imagine all the profit lost. Well, there’d also be innumerable workhours saved but those would be other people’s hours. So none of that would actually be desirable. Besides, no one except the engineers actually cares about reliability and efficiency. The people in charge don’t want to invest in it, and the people buying tend to cross their fingers and ignore all the previous bets they lost, even as they end up paying more.
Pierce R. Butler says
My Verizon account, in the last few months, has started labeling some incoming calls as “Potential Spam” without displaying the calling number. At first I welcomed this as a teeny pushback against phone hustlers, but have started wondering what criteria their algorithms use since various calls get through that filter from 800- and 888- numbers (an obvious red flag, no?).
Maybe those “Potential Spam” calls come from, ah, entrepreneurs who haven’t made, ah, partnerships with Verizon.
Ridana says
Well the first part of that was a nostalgic read. I might have mentioned this before, but I remember when we got hooked up to Bitnet and could send email and iirc, actually chat in real time once you connected to another user. The office where this was set up had only one phone line though, so you couldn’t use Bitnet while someone was on the phone.
One day I was on the computer and the other person in the room picked up the phone to call out. Rather than simply disconnecting my session as usually happened, I got this on my screen:
I am a Macintosh.
I am a Macintosh emulating VT100 terminal.
I am a Macintosh.
I have no idea what I tapped into and could never reproduce it, but what puzzles me is why entire sentences like that were written into the code (of Bitnet? the Mac SE?) to be displayed on some trigger rather than what I would assume the actual coding would look like to communicate between handshaking computers (but not being a coder, I don’t know what that would look like). I’ve always had this image of the poor computer with its hands over its ears trying to drown out the static and remind itself who it was and what it had been doing before the phone scrambled its brain. :D
.
The rest of the article was interesting as usual, but depressing as hell (which is why I went for the nostalgia balm).
billseymour says
I have never used anything like Facebook.
I have one phone hooked up to my land line: a Western Electric dial-up instrument in a black bakelite case. As will probably come as no surprise at all, it’s still going strong. “They don’t make ’em like that anymore.”
I never answer the phone right away, even when I’m sitting right next to it. Folks who know me will begin to leave a message on the answering machine. If it’s somebody I want to talk to, I’ll answer. At present, I get maybe ten calls a day with no message left. Once the election ends, I’ll probably be back to two or three per day.
I do have a Verizon hotspot that I use for connecting to the Internet. I needed it for travel anyway, so I never saw a need to get a wired connection at my home. It’s plenty fast for e-mail and FtB. 8-)
Jazzlet says
Your prices are crazy, you can get reliable high speed broad band in the UK for £20-25 a month, maybe even better if you have a history of being prepared to change provider. Most companies have good introductory offers which you can hold onto for longer if you have a history of changing provider as the retaining staff know you mean it when you say “make me a better offer, I can get £xx from your rival”. You have reminded me we need to think about this again.
cvoinescu says
Jazzlet @ #5:
That is true if you live close enough to an exchange for ADSL to work, or in an area where BT have installed fibre, or Virgin (or one of their predecessors) have run cable. There’s also good 4G broadband, albeit more expensive and not unlimited, and it covers only the more densely populated areas. If you’re in one of those areas and aren’t unlucky to be plagued by technical difficulties, it’s cheap, reliable and rather good (although, to be fair, many European countries have it better — and cheaper).
If you’re outside those areas, though, you’re out of luck. The current government have trumpeted rural broadband access, and grants for connecting people. As with everything Boris, the truth is… more complicated than that. The grants are capped at a ridiculously low amount (several thousand pounds, which is peanuts when you’re paying for digging kilometres of trench or installing dozens of poles), and they apply to 10 Mbps ADSL, not fibre. In effect, the much-touted grants are good only if there’s already broadband in your village, and not too far from you. If there isn’t, BT quotes can go into the tens of thousands, or even over £100,000, for connection to lousy 10 Mbps ADSL. Once your neighbour gets connected, you may be able to connect for free — but there’s no provision of sharing the cost between households, so that 40 houses connecting at the same time would come to £2,500 each and would be covered by the grants. Ofcom say they’re working on this, so maybe things will get better for the unfortunate 20% or so, but right now they are not good.
https://www.theguardian.com/money/2020/sep/14/bt-broadband-bills-could-reach-100000-for-rural-users
Marcus Ranum says
The way the US has it set up, the broadband companies have to offer a “competitive option” which means that so long as there is satellite (also around $300/mo and really unreliable) they can charge what they want. Which, out here, means a bandwidth cap and a high basic rate. Some months – like whenever Apple or Microsoft release a new wad of bloatware – I get smacked with $150+ of bandwidth charges.
It’s absolutely unconscionable, but, hey, capitalism makes markets more efficient — for the people who control the market.
If Starlink works half decently, Verizon will lose their entire rural customer base, and good riddance.
dangerousbeans says
Come on, I was 9. I was probably playing with lego
I can’t remember the last time i felt a change in software was an improvement. Maybe XP? I should go hit some hot steel instead
cvoinescu says
Ridana @ #3:
I think two things happened.
When a host sends Ctrl-A to a terminal, it responds with an identification string. Ctrl-A is ASCII 1, which is one of those characters that is easily generated from noise (LSB first, all it needs is one set bit followed by some clear bits). The off-the-hook phone must have confused the modem into thinking it had received a Ctrl-A character, which it dutifully passed on to your Mac.
The off-the-hook phone also changed the impedance of the line as seen by the modem. The impedance mismatch caused the output signal to be reflected into the input — in other words, the modem thought it received whatever it transmitted, so echoed it back to the Mac. Following the spurious Ctrl-A, it echoed the terminal identification string sent by your terminal emulator back to it, which displayed it.
This happened three times, but noise probably messed it up halfway in two of those cases: the first and third copies of the identification string are incomplete. That it looks so much like poetry is coincidence.
Marcus Ranum says
dangerousbeans@#8:
I can’t remember the last time i felt a change in software was an improvement. Maybe XP?
That was because Windows 95 was so horrible. And Windows 95 was a huuuuge improvement over 3.1, because it had a networking stack built into it, instead of loaded as a terminate-and-stay-resident driver. The main thing that XP did was “not bluescreen as much as Windows 95” which was an improvement that was notable but hardly appreciated.
Ridana says
9) @ cvoinescu:
Thanks for the explanation. I assumed something like that was going on, but I was surprised that the identification strings were so…ordinary. I just expected it to look more technical and cryptic with arcane punctuation and abbreviations, like up there in the banner header, not straightforward, anthropomorphizing sentences that anyone could understand. :D
cvoinescu says
Ridana @ #11:
Well, it was a Mac. Real terminals just say things like ‘vt52’ or ‘vt420’. There’s also a more technical feature string that describes the capabilities of the terminal in some detail. I think that’s invoked by ESC Z, which is not a likely noise shape for a modem.