Dran

You can’t just write off capital expenditure though. The hardware, even for “effecient” MOE inference is still very expensive to buy, house, run, and cool. Even assuming open-weight model serving at $0 r&d for the models themselves, mixing high-prefill workloads doesn’t batch well with decode heavy concurrency (or other prefill-heavy jobs). The moment you do anything nontrivial you start running into very complicated architectural problems to efficiently solve at scale.

Hardware that is useful for 5-10 years at most, plus development and support for the inference workflows, doesn’t leave a lot of margin on the table.

My gut, along with basically everything I read, suggests that not most (even pure inference) shops are not profitable and are still floating on loans or vc money.

Can you cite your source on the claim that “inference is currently insanely profitable”? Everything I read suggests that openai and anthropic lose money on their plans.

Good stadium nachos

Name me a worse liquor, I’ll buy it next week if I can find it local, and I’ll report back.

Did you go to uni in hell or chicago?

Malort

Tastes like turpentine and grapefruit juice. The former I’ve actually tried accidentally… dipped my paint brush in my cup of water and took a swig of the other cup. Somehow, the malort was worse. Learned recently that they make a barrel aged version that they claim is

dare we say, sippable

We do not.

ssh keypairs secure from the point of authority. In the case of you logging into your account, the server’s job is to ask a question that only you can answer.

In the case of a password, the remote server doesn’t store your password either, it stores a derivative hash that can, in theory, only be generated using complex math + your password as an input. You are the only one that stores your actual password.

In the case of an ssh keypairs, it works very similarly. The public key allows the server to cryptographically ask a question that only the private key can generate an answer to correctly.

It is fundamentally the same secret exchange handshake as a password just with a few extra steps to make things more secure during automation. A password can be weak and guessable, an ssh key cannot (at least not any more than other keys of the same algorithm can).

For music enthusiasts plexamp is also basically unbeatable. I welcome the day open source catches up.

Microvms or containers could give you external control of the networking. Then you would put whatever you want behind warp inside the warp container/vm.

+1 to this observation. I run zfs arrays at both home and work and it’s way more likely that your controller is flaking than you have that many simultaneous drive failures.

The unfortunate reality though is that you can’t trust the current copy of this data, even the snapshots, unless the restore passes a scrub post-restore.

Less cynically, I believe the argument in scripture is the inverse. Man was created in god’s image therefore we probably inherited a lot of properties of the devine.

Inference is dirt cheap in comparison. Hundreds to thousands of concurrent users can be served by hardware costing in the high-thousands to low-ten-thousands.

Training those same foundational models is weeks to months of time on tens to hundreds of millions worth of hardware.

If caddy is acting as a proxy for anything, you should not need to forward that port externally. Local host firewalls allowing traffic on your local network is sufficient.

Depending on your physical host layout you may be looking at an issue with nat reflection.

You have not given us enough about your topology to assist in troubleshooting.

What is the context here? What was the original inquiry?

She’s old. She doesn’t want to read a book. As best as I can tell she wants to have something slightly brain engaging during commercials when watching shows, but is far too stubborn to learn a new game she doesn’t already know.

Who are we to tell someone what they should want to do with their twilight years?

The unfortunate reality is they cannot be avoided in some cases. There is not a paid alternative to Facebook, nor are there to a lot of f2p mobile games.

My grandma had a tablet about a decade ago, and I loaded it up with tons of paid $1-$3 casino games for her (it’s what she wanted) but a decade later, when going to reinstall them to a new tablet, all of them no longer exist on the play store and seemingly 100% of current games are either ad supported or require iap to refil your virtual currency.

She literally did what you asked and today she still has no options. What should my 86 year old grandma do in this case?

Chinese, specifically so I can exclusively curse in it like they did on firefly.

I switched to Niagara a few years back because Nova didn’t have good support for foldables and tbh I haven’t looked back. It’s very different but once you get used to it it’s much faster than a traditional launcher.

Because $350 couldn’t possibly buy enough hardware to run a modern operating system!

• Microsoft, probably