As compute has outpaced memory bandwidth most recent stuff has moved away from ReLU. I think Llama 3.x uses SwiGLU. Still probably closer to ReLU than logistic sigmoid, but it's back to being something more smooth than ReLU.

Indeed, there have been so many new activation functions that I have stopped following the literature after I retired. I am glad to see that people are trying out new things.

Parsing this for people that didnt get that it was a clear joke: Musk worked without a work visa and Trump is a convicted felon.

App store developers and app store participants don't have a good way to collectively organize, whereas Apple shareholders get all kinds of support to organize together.

How about when there are 128-256 core consumer CPUs?

And people are running things that take minutes to run when a good multi-cpu framework would make it seconds.

Maybe add a dataflow analyzer to Python and do it for people.

Aren't you relying on the "recently" definition of just here rather than the "simply" definition?

They said he wanted to shoot it but decided that wouldn't do enough damage.

> But yeah, some random neckbeard's blog is more authoritative than Janis' own site, for sure!

That site said it was made by super fans in 1998? Doesn't seem like go to source for critical quotes (not that an official site would be either).

Here's a source for the quote about him not liking her band from 2013, so no, it doesn't seem to have been hallucinated by the 2020 author:

https://daily.redbullmusicacademy.com/2013/12/robert-crumb-i...

Florida and Tennessee recently changed rules to allow foreign doctors to be licensed more easily.

But doctor hours are mostly fungible.

After the dedicated server code is decompiled, I could see that causing more cheats.

It would also result in cheats getting identified and reported by the community.

The TF2 dedicated server mailing lists, back in the day, were filled with new cheats, crashes, and exploits being found and reported by server admins.

That's pretty cool. How is cheating in TF2 in 2024 by the way?

The increase in bots and cheaters got progressively worse as matchmaking took over and ate away at the ability of private servers to maintain a community. Also before that, TF2 becoming a giant microtransaction experiment certainly didn't help.

Still though even today I can open up TF2 and still have a few favorited servers that have been going for a decade+. I can join those servers and play bot and cheater free for the most part.

TF2, totally not currently riddled with cheaters and bots.

The increase in bots and cheaters got progressively worse as matchmaking took over and ate away at the ability of private servers to maintain a community. And before that, TF2 becoming a giant microtransaction experiment certainly didn't help.

Also the mailing list I spoke of are basically dead at this point as the number of invested server admins has dwindled.

Still though even today I can open up TF2 and still have a few favorited servers that have been going for a decade+. I can join those servers and play bot and cheater free for the most part.