Alex Shtoff (@AlexShtf) header
Alex Shtoff (@AlexShtf) profile picture

Ph.D. Principal Scientist Ex @YahooResearch. I do machine learning ∩ numerical methods ∩ SW dev.

Israel
Joined August 2012
Photo by Alex Shtoff (@AlexShtf)Photo by Alex Shtoff (@AlexShtf)Photo by Alex Shtoff (@AlexShtf)Photo by Alex Shtoff (@AlexShtf)Photo by Alex Shtoff (@AlexShtf)Photo by Alex Shtoff (@AlexShtf)Photo by Alex Shtoff (@AlexShtf)Photo by Alex Shtoff (@AlexShtf)Photo by Alex Shtoff (@AlexShtf)Photo by Alex Shtoff (@AlexShtf)
🔥︎Delighted, thrilled, happy and please to share torchcurves - parametric curves in pure PyTorch. I believe it's mature enough to share here. Inspired by a two-year old paper from Yahoo. code: github.com/alexshtf/torchcur… docs: torchcurves.readthedocs.io paper that inspired it: openreview.net/forum?id=M422… Use: pip install torchcurves or my personal preference: uv add torchcurves A small library of vectorized, differentiable B-spline and Legendre curves with learnable coefficients. Handy for continuous embeddings of numerical features in your recommender system, shape-constrained models (e.g. monotonicity via non-decreasing control points) in your ad surplus optimization work, and KAN-style layers. I set out to keep it small, pure PyTorch, readable, and easy to maintain, with only modest speed ambitions. It is reasonably fast for such a library, and the performance comes mainly from leaning on PyTorch’s vectorization and efficient algorithms (Cox-De Boor for the splines, Clenshaw for the polynomials). The vectorized code can evaluate several curves at a batch of points in one call. Gradients flow to both the inputs and the coefficients via custom autograd. It’s not the fastest implementation out there, but it stays simple and transparent. Would love to that it works for you, and what would make it better. Have fun using it!
3
4
1
81
554,865
I am no longer volunteering to review at TMLR. The aggressive desk rejection policy, even if remove a lot of slop, also has plenty of false positives that throw away months of years of people's work just because of the AE's intuition. Until some measures to reduce false positives are found, I don't believe I should contribute my time to such a venue.
6
2
2
44
11,073
This. If it isnt available to everyone, it isnt a release.
It should not count as a release if no one but a select few can use the model.
1
4
312
The speed of modern CPUs is unimaginable. I have a new shiny P14s Gen 7 laptop (Intel CPU), and it is FAST.
10
440
I dont understand the backlash against Terra based on terminal bench. Who cares? Remember that its also a language model. You know, for tasks like understanding human language and generating human language. Something OpenAI models tend to do better than Anthropic's. Not to mention vision - Opus cant see what old good Luna sees.
2
225
OK, I don't know if the papers in my batch are AI slop. I have no way of reliably detecting AI. But they are slop. An incomprehensible mess. Someone just assembled a bunch of numbers, letters, lemmas and propositions, with a lot of symbols and indices, and asked me to read it.
This year's ICLR I got no papers to review about LLMs or transformers. Great success! Finally - no more LLM / Transformer mumbo jumbo!
2
1
45
2,484
4 slop papers - reject. 1 good paper - accept. What a bad review experience :(
3
208
Yes. And new, weird and unusual ML stuff. Because it's not in your AI's training data.
Be smarter than AI, work on ml theory!
1
248
Alex Shtoff retweeted
Replying to @ziv_ravid
Disagree with "measure their impact". Impact if good science in many cases come many years after publication, and in extreme cases - even decades. We should promote good science, and accept that we have no way of predicting which papers will turn out to be impactful.
1
121
Alex Shtoff retweeted
Looking for a postdoctoral fellow in deep learning with a solid theoretical background to work on learning from imbalanced data. Joint project with J.-M. Loubes in Toulouse, France. The sooner you can start, the better. Write to [email protected]
1
5
5
425
So when will model-providers start publishing slop-scores in their model cards, i.e., benchmarks with multiple episodes, where a model is punished for creating complexity in first episodes that affects the resources required for success in the future episodes?
1
1
2
470
So - has Argon solved it?
My model strength benchmark: find a pivoting rule for the simplex algorithm leading to a polynomial time termination, or prove no such rule exists. Share yours :)
1
369
What I can understand from the latest discourse on AI for math is this - 𝑂 hacking is all you need.
214
My dream had always been to prove beautiful theorems as the AI agents unloaded my dishwasher. Well, it went the wrong way... 😂
40
311
38
2,875
136,196