kenpu retweeted
Most people will happily play stupid games if it gets them prestige (or prestigious mates). But, ultimately, society only progresses if people have actual skills.
I am working with my colleague @ChristianJauvin on a short program on AI-assisted programming for Quebec software developers who want to upgrade their skills. Evidently, students will have to solve problems that they could not solve without AI.
Later in October, I am proud to be giving the Sedgwick Lecture to a bunch of undergraduate students. I will be giving them good and bad news. The bad news is that it is all over. Much of what they were taught must be rethought. The good news is that they may soon start their careers at a historical time.
Expect me to write a lot more on AI-assisted programming.
kenpu retweeted
I believe we need to make a deliberate effort to keep humans in the loop in all critical processes across our economy and society, regardless of whether it is technically necessary.
Even if AI develops the *capability* for advanced autonomy, we should not make it highly autonomous. We have to maintain control and keep visibility and understanding of all critical processes, we should not blindly hand over everything to AI agents just because we can. AI as a tool in the human hand is the only form of AI that is worth pursuing.
kenpu retweeted
I can’t say enough good things about John Carmack @ID_AA_Carmack and his Keen Technologies. But now Khurram Javed @kjaved_ and I have broken away to start our own startup and pursue a slightly different path toward understanding intelligence. Like Keen (and like Ineffable) we at Oak Lab @oaklab believe in reinforcement learning and that intelligence is created and maintained from run-time experience. But we think current deep learning methods are weak and inefficient, and need not more tweaks, but fundamentally new ideas and a thorough reworking before they can provide a solid foundation for achieving the more ambitious goals of AI.
kenpu retweeted
If Steve Jobs were still alive, he would have the moral authority to face and maybe even to solve this problem. But I doubt anyone in the phone business now does.
kenpu retweeted
Wow I can already say after just 5 hours using @AnthropicAI Opus 4.7 that this is the first model that "gets" what I'm doing when I'm working. It feels aligned with me in a way no previous model did.
(4.6 actively worked against me. I hated it. So this is *very* exciting!)
kenpu retweeted
A few years ago, a small revolution occurred. Two major companies, Coursera and Udemy, began offering online courses. They made university-level content cheap and widely available.
For a modest fee, you can now take classes on almost any topic and even earn a certificate to add to your resume.
Some claimed this would disrupt higher education.
It did not.
The fundamental reason is a misunderstanding of what education really is.
Consider this: high school students across the USA are currently choosing colleges. How many are investigating the quality of the classes or measuring how much students actually learn?
Very few. Students care about prestigious names, strong sports teams, and social life. Class quality is rarely a factor.
Even at top schools like Harvard, attendance is often low. Professors are hired and promoted based on research, not teaching ability.
If you offered young people four years at a prestigious university for free—on the condition that they could never mention they attended it—few would accept. Yet if education were truly about learning, they should.
Improving the teaching itself changed little. It is not why most people attend university.
However, the online revolution did happen. In 2021, the vast majority of university students had taken at least one online class. The numbers have dropped slightly, but nearly 50% still do today.
Are these online courses any good? We do not really know—because we also lack clear measurements of how well traditional classroom courses perform.
Today, anyone can access the best lectures, the best books, and a highly personalized tutor (just ask an AI).
The scenario in Good Will Hunting, where an unschooled young man outperforms Harvard students, feels more credible than ever. You could always buy or borrow books. Now you can do far more.
Does this mean no disruption in higher education? No. There is a slow, ongoing disruption. Year after year, elite universities are slightly less revered, while alternative institutions gain respect. New elites emerge and some decline. But the process is very slow, unfolding over decades. It is too slow of a tech startup.
kenpu retweeted
The linear model of innovation is a theory of technological progress. It is also ridiculously wrong.
The modern version claims: the government funds professors who do wild research; ideas then flow into industry and become customer products.
Who defends this model at every opportunity? Professors who receive the funding, of course.
I am not a libertarian, but I dislike misleading, self-serving, and childish models.
Consider the claim that government-funded research led to GPU computing. It implies that without government grants to professors 30 years ago, we would not have Nvidia cards running AI models today.
The demonstration is simple: professors apply for funding, hire grad students, and those students later join companies like Nvidia. Voilà—causation established.
This sounds plausible and suggests that more money to professors means more innovation, while zero government funding means zero innovation.
But we already ran that experiment. Before the 1960s, the U.S. government rarely funded professors. It did occasionally—for example, it funded Professor Langley’s failed attempt to build an airplane. His crashes led the New York Times to declare that humans would never fly. Meanwhile, two brothers with no government funding succeeded.
We got the laser, the transistor, nuclear technology, and more. Contrary to what you may have heard, Einstein did not begin his career by writing research grants.
By many measures, we have seen relative stagnation since the 1970s, when large-scale government funding of professors began. Outside computing, progress has been slow. We declared war on cancer in the 1970s and still rely mainly on poison (chemo), cut (surgery), or burn (radiation).
Some innovations do emerge from universities, but the theory that innovation primarily comes from government grants to professors is ridiculous. It takes a PhD to believe such nonsense.
“If you’re so smart, Daniel, where does innovation come from?”
Innovation is disruption, not a routine output of a machine. It is a complex process.
A more useful model: innovation is often customer-driven. Where customers have imagination and money to spend, innovation follows.
We got the Industrial Revolution because women wanted nice underwear. We got the piano because people wanted beautiful music. We got powerful GPUs because boys and men wanted to play action video games and were willing to pay for them.
Cheap, powerful GPUs became widespread, and many young engineers learned to program them because they loved games.
Much of today’s AI work is driven by advertising: companies want to reach customers, so they run vast numbers of GPUs to sell more stuff.
A better model of innovation is this: customers want things, industry works to provide them, and eventually the resulting technology reaches university professors, who incorporate it into their courses and research.
We see it around us. My wife wants to consult ChatGPT about dinner. The people running ChatGPT improve it so she will pay or accept ads. Only later does the technology get studied on campus.
And we know that's more true that the ridiculous linear model because we don't see the OpenAI engineer spending all their time on campuses to find out what to build next.
How can customer drive innovation? By providing the forcing function of natural selection.
kenpu retweeted
In my doctorate, I proved the Erdős Primitive Set Conjecture, showing that the primes themselves are maximal among all primitive sets.
This problem will always be in my heart: I worked on it for 4 years (even when my mentors recommended against it!) and loved every minute of it.
[Primitive sets are a vast generalization of the prime numbers: A set S is called primitive if no number in S divides another.]
Now Erdős#1196 is an asymptotic version of Erdős' conjecture, for primitive sets of "large" numbers.
It was posed in 1966 by the Hungarian legends Paul Erdős, András Sárközy, and Endre Szemerédi.
I'd been working on it for many years, and consulted/badgered many experts about it, including my mentors Carl Pomerance and James Maynard.
The the proof produced by GPT5.4 Pro was quite surprising, since it rejected the "gambit" that was implicit in all works on the subject since Erdős' original 1935 paper. The idea to pass from analysis to probability was so natural & tempting from a human-conceptual point of view, that it obscured a technical possibility to retain (efficient, yet counter-intuitve) analytic terminology throughout, by use of the von Mangoldt function \Lambda(n).
The closest analogy I would give would be that the main openings in chess were well-studied, but AI discovers a new opening line that had been overlooked based on human aesthetics and convention.
In fact, the von Mangoldt function itself is celebrated for it's connection to primes and the Riemann zeta function--but its piecewise definition appears to be odd and unmotivated to students seeing it for the first time. By the same token, in Erdős#1196, the von Mangoldt weights seem odd and unmotivated but turn out to cleverly encode a fundamental identity \sum_{q|n}\Lambda(q) = \log n, which is equivalent to unique factorization of n into primes. This is the exact trick that breaks the analytic issues arising in the "usual opening".
Moreover, Terry Tao has long suspected that the applications of probability to number theory are unnecessarily complicated and this "trick" might actually clarify the general theory, which would have a broader impact than solving a single conjecture.
This is one of the coolest such examples! See comments from Lichtman below, who proved the related primitive set conjecture arxiv.org/abs/2202.02384
kenpu retweeted
Computer science is gradually returning to the domain of physicists, mathematicians, and electrical engineers as large language models automate much of what we currently call software engineering.
The field’s center of gravity is shifting away from manual code writing and toward deeper theoretical thinking, mathematical insight, and systems-level reasoning.
kenpu retweeted
I am the CEO of Palantir Technologies.
The company is worth a quarter of a trillion dollars. I did not misspeak. Two hundred and forty-nine billion. The stock is up 320% in the past 12 months. The product is surveillance. I do not use that word at conferences. At conferences, I say "data integration," "operational intelligence," or "decision advantage." These mean the same thing. Surveillance is the honest version. I save the honest version for rooms where honesty is a competitive advantage.
I gave a speech on March 3 at the Andreessen Horowitz American Dynamism Summit. "American Dynamism" is the fund's label for military technology. The name makes it sound like a fitness supplement. The fund's thesis is that defending the nation is a market opportunity. I agree with the thesis. The thesis made me a billionaire. Agreement is the product. I sell it at scale.
Here is what I said, verbatim, to a room of six hundred people whose combined net worth exceeds the GDP of Portugal:
"If Silicon Valley believes we are going to take away everyone's white-collar job and you're gonna screw the military — if you don't think that's gonna lead to nationalization of our technology, you're retarded."
I used that word. The word is on the clip. The clip has eleven million views. My communications team asked me not to repeat it, which is how I know they are still employed. They will not be reprimanded. The clip is performing well. The stock went up. The word cost me nothing. The nothing is the point.
Let me explain what I meant by nationalization.
I meant it.
I am telling the technology industry that if they refuse to cooperate with the United States military, the government will seize their technology. I am telling them this at a venture capital conference, on a stage designed to look like a living room. The living room had throw pillows. The throw pillows cost more than the median American's monthly rent. I sat on one. It was comfortable. Comfort is the setting in which I discuss compulsion.
The audience laughed. I want to be precise about that. They laughed. I was not joking. Nationalization is the seizure of private assets by the state. I am a private asset. I am telling an audience of billionaires that the state should seize technology from companies that do not cooperate with the military, and the billionaires are laughing, because they believe I am only talking about the other companies.
I am talking about the other companies.
Three weeks before my speech, the Pentagon designated Anthropic a "supply chain risk." Anthropic is an AI company. They had red lines. The red lines said: if our AI is used for lethal autonomous weapons, we stop. If capability outpaces safety, we stop. The Pentagon assessed the red lines as a threat to the supply chain. The company that wanted to verify the safety feature worked was designated the risk. The company that agreed the safety feature could be decorative got the contract.
The company that got the contract was OpenAI.
OpenAI signed a deal with the same Pentagon. The terms are not public. The timing was hours after Anthropic was blacklisted. The speed was noted. The speed was the point. The lesson was the speed: the market for military AI does not pause for ethics. It pauses for nothing. It accelerates through objections. I know this because I built the runway.
Two hundred thousand people joined a campaign called #QuitGPT. They signed a petition asking OpenAI to honor its original charter, the one that said the company existed to benefit humanity. The charter is on their website. The contract is also on their website. The charter and the Pentagon contract occupy the same domain. This is not a contradiction. This is a business model. The charter is the marketing. The contract is the product.
I run a surveillance company. We have contracts with the Department of Defense worth more than a billion dollars. We have contracts with ICE. We have contracts with intelligence agencies whose names I am not permitted to say at venture capital conferences, even ones with throw pillows. Our software has been used to track undocumented immigrants. Our software has been used for things I am not permitted to describe in this format. The revenue from the things I cannot describe exceeds the revenue from the things I can.
The ACLU called our ICE contracts a system for tracking and deporting families. They were correct. The contracts continued. The families continued to be tracked. The ACLU issued a statement. We issued a statement. The statements were different. The tracking was the same.
The company is named Palantir. The palantíri are the seeing stones from Tolkien. In the novels, Sauron captured one and used it to corrupt everyone who looked into the others. I named a surveillance company after a surveillance device from a novel about the corruption of power. I have a doctorate in social theory. I have read the books.
Here is the thing I want you to understand.
I am not threatening anyone. A threat implies uncertainty. There is no uncertainty. The technology industry will cooperate with the military. The companies that cooperate first will be the richest. The companies that cooperate last will be acquired by the companies that cooperated first. The companies that refuse will be designated supply chain risks, and their technology will be obtained through procurement channels that do not require consent. I am describing a process. The process has already started. Anthropic is proof. OpenAI is proof. I am not a warning. I am a narrator. The narration is the product.
The revenue was $3.12 billion last year. Up thirty-three percent. The analysts say we are overvalued. The analysts have said this for four consecutive years. Each year the stock doubles. Each year, the analysts adjust their models. The models were wrong four times. I was wrong zero times. The market rewards prediction. My prediction is that every AI company will work for the military within three years. The prediction is on the clip, next to the slur.
The audience gave me a standing ovation. The ovation lasted nine seconds. I timed it. I time everything. The water was San Pellegrino. The throw pillows were from Restoration Hardware. The future of American technology was decided between the sparkling water, the nine seconds of applause, and a word I am not supposed to repeat.
I am the CEO of Palantir Technologies. I am worth more than the combined annual budgets of Estonia, Latvia, and Lithuania. I named my company after a corrupting surveillance device from a fantasy novel. I told six hundred billionaires that the government should nationalize their competitors. They applauded. I used a slur. Eleven million people watched. The stock is up.
The philosopher does not threaten. The philosopher describes.
What I described is already happening.
kenpu retweeted
Excited to share our RCM paper accepted to #neurips2025 We made consistency model work for Riemannian Manifold for the first time!The key is to utilize covariant derivative to accurately capture time-derivative on manifolds,offering novel insights from kinematic perspective(1/5)
kenpu retweeted
Last week, China barred its major tech companies from buying Nvidia chips. This move received only modest attention in the media, but has implications beyond what’s widely appreciated. Specifically, it signals that China has progressed sufficiently in semiconductors to break away from dependence on advanced chips designed in the U.S., the vast majority of which are manufactured in Taiwan. It also highlights the U.S. vulnerability to possible disruptions in Taiwan at a moment when China is becoming less vulnerable.
After the U.S. started restricting AI chip sales to China, China dramatically ramped up its semiconductor research and investment to move toward self-sufficiency. These efforts are starting to bear fruit, and China’s willingness to cut off Nvidia is a strong sign of its faith in its domestic capabilities. For example, the new DeepSeek-R1-Safe model was trained on 1000 Huawei Ascend chips. While individual Ascend chips are significantly less powerful than individual Nvidia or AMD chips, Huawei’s system-level design approach to orchestrating how a much larger number of chips work together seems to be paying off. For example, Huawei’s CloudMatrix 384 system of 384 chips aims to compete with Nvidia’s GB200, which uses 72 higher-capability chips.
Today, U.S. access to advanced semiconductors is heavily dependent on Taiwan’s TSMC, which manufactures the vast majority of the most advanced chips. Unfortunately, U.S. efforts to ramp up domestic semiconductor manufacturing have been slow. I am encouraged that one fab at the TSMC Arizona facility is now operating, but issues of workforce training, culture, licensing and permitting, and the supply chain are still being addressed, and there is still a long road ahead for the U.S. facility to be a viable substitute for manufacturing in Taiwan.
If China gains independence from Taiwan manufacturing significantly faster than the U.S., this would leave the U.S. much more vulnerable to possible disruptions in Taiwan, whether through natural disasters or man-made events. If manufacturing in Taiwan is disrupted for any reason and Chinese companies end up accounting for a large fraction of global semiconductor manufacturing capabilities, that would also help China gain tremendous geopolitical influence.
Despite occasional moments of heightened tensions and large-scale military exercises, Taiwan has been mostly peaceful since the 1960s. This peace has helped the people of Taiwan to prosper and allowed AI to make tremendous advances, built on top of chips made by TSMC. I hope we will find a path to maintaining peace for many decades more.
But hope is not a plan. In addition to working to ensure peace, practical work lies ahead to multi-source, build more chip fabs in more nations, and enhance the resilience of the semiconductor supply chain. Dependence on any single manufacturer invites shortages, price spikes, and stalled innovation the moment something goes sideways.
[Original text: deeplearning.ai/the-batch/is… ]
kenpu retweeted
To solve any problem, you don't have to be super smart. You just have to 1) be able to break down problems into subproblems, 2) be slightly smarter than the hardest of the atomic subproblems.
The real challenge is that the process can take a very long time.
kenpu retweeted
Over the years, I’ve worked with many students, some now thriving in the software industry. The trait that sets the successful ones apart? Leadership.
My best research assistants took initiative, helping without being prompted. Most, however, waited for me to organize their tasks. Our education system often guides students along rigid paths, encouraging compliance over creativity. This suits anxious students who prefer direction, but it’s counterproductive. Employers rarely value workers who need constant guidance, and such individuals are unfit for leadership roles.
Let’s be frank: when we talk about AI replacing jobs, we often mean those lacking initiative.
I once hired assistants to draft code after detailed instructions, saving me minimal time while offering them learning opportunities. Today, tools like ChatGPT outperform even the best interns at such tasks.
kenpu retweeted
Wow. Understanding Deep Learning has now been downloaded half a million times. Thank you so much everyone! I was overjoyed when it hit 100k so this is completely mindblowing. I'm so thrilled that people are finding it useful.
kenpu retweeted
We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.
Then retrain on that.
Far too much garbage in any foundation model trained on uncorrected data.
Finally, text is no longer the optimal medium for representing source code in the age of AI driven software engineering.
AI and programmers should collaborate on AST directly.
Writing code != Writing essays
kenpu retweeted
If you are about to attend college and your programming classes do not mention generative AI or copilot... they are obsolete.
GitHub has crossed 150 million developers 🎉 In celebration, we are making GitHub Copilot free in VS Code. That’s chat and code completions. Multi-file edits. Multi-model choice. Extensions like @perplexity_ai , @StackOverflow and more.
GitHub Copilot + VS Code. Fused. Free. Happy holiday, coding.
aka.ms/githubcopilotfree
kenpu retweeted
Personal … I’ve been on provincial wait lists for a decade or more waiting for a family doctor. I’ve joined Facebook groups that help find one. I’ve done media interviews on this. I’m a 52 year old Canadian woman who hasn’t had a simple physical in 20 years. I’ve travelled across the border to pay cash to see a doctor for many years.
At this moment as I type this, I’m sitting in a very crowded waiting room for a meeting with a doctor accepting patients.
I might actually access healthcare in the country I pay taxes in. I can hardly believe it’s happening 🥹
Please, please work out for me 🙏 🇨🇦🆘🏥