Ed Hagopian (@EdH@mastodon.social) (@EdHagopian) header
Ed Hagopian (@EdH@mastodon.social) (@EdHagopian) profile picture

VP - Product Security @ Cream City Cyber: Opinions are my own, not CCC. Interests: AI,IoT, Woodworker, Blacksmith, Welder, Maker. Polymath.

Milwaukee, WI
Joined March 2007
Photo by Ed Hagopian (@EdH@mastodon.social) (@EdHagopian)Photo by Ed Hagopian (@EdH@mastodon.social) (@EdHagopian)Photo by Ed Hagopian (@EdH@mastodon.social) (@EdHagopian)Photo by Ed Hagopian (@EdH@mastodon.social) (@EdHagopian)Photo by Ed Hagopian (@EdH@mastodon.social) (@EdHagopian)Photo by Ed Hagopian (@EdH@mastodon.social) (@EdHagopian)Photo by Ed Hagopian (@EdH@mastodon.social) (@EdHagopian)Photo by Ed Hagopian (@EdH@mastodon.social) (@EdHagopian)
Analysis aided by AI just revealed that sperm whale clicks are essentially whale equivalents to human speech sounds. It's incredible to see AI doing things for research in so many different fields. Genuinely curious to know how smart they are. teapawt.org/begusgasper/status/173…
Sperm whales have equivalents to human vowels. We uncovered spectral properties in whales’ clicks that are recurrent across whales, independent of traditional types, and compositional. We got clues to look into spectral properties from our AI interpretability technique CDEV.
5
35
1
207
30,487
RT @omarsar0: Toward Language Agent Fine-tuning Explores the direction of fine-tuning LLMs to obtain language agents. Finds that languag…
6
1
ChatGPT-4V Multimodal decodes a Redacted government document on a UFO sighting released by NASA. I have tested this on 100s of redacted documents and I can say we are in a new world.
306
611
274
3,272
2,102,036
Want to understand how LLMs and Transformers work? This is by far the best visualization I've seen. The article makes you understand the fundamental concepts in 5 min. ig.ft.com/generative-ai/
5
127
4
499
99,237
The `rebel-large` model is awesome for relation extraction 🔗 Paired with CUDA, it’s blazing fast ⚡️. With @llama_index 🦙, we can now build a knowledge graph over any text data super quickly! 🕸️ Full Colab notebook showing how you can use it: 
 colab.research.google.com/dr…
19
219
15
970
181,861
Faster sorting algorithms discovered using deep reinforcement learning nature.com/articles/s41586-0…
1
1
1
2
408
Neural Nets for NLP - Carnegie Mellon This is a great course that covers neural networks techniques and algorithms for natural language processing. Covers neural network architectures for language modelling such as recurrent networks and transformers, tips and tricks for training and debugging language models, multilingual learning, and much more. Lecture videos of Neural Nets for NLP: youtube.com/playlist?list=PL…
11
126
5
527
117,739
Microsoft just dropped a bombshell. All free ChatGPT users can browse the real-time internet using the 'Browsing with Bing' plugin soon. 5 insane browsing prompts I tried on GPT-4 that everyone can access soon:
138
782
75
4,282
2,125,551
How to use #chatGPT for effective* learning? A glimpse into the future of learning. (Spoiler: The future is already here.) *fun, engaging and memorable **Snoop Dogg is going hard on me in this one! 😅 A mini-🧵 in 3 parts:
11
14
7
150
31,374
This is wrong. Developers and community are moats. Like I said yesterday. You think @khanacademy is going to rip out GPT underneath its new AI-centric education system? And it is one of many building on top of GPT. You are insane if you think that. Google will never get Khan to switch. That is a moat.
Leaked Google document: “We Have No Moat, And Neither Does OpenAI” The most interesting thing I've read recently about LLMs - a purportedly leaked document from a researcher at Google talking about the huge strategic impact open source models are having simonwillison.net/2023/May/4…
69
22
13
245
254,176
This is the scariest tweet I've made in a long time. On Friday I met with a psychiatrist, @MundinMd and did a 30 minute session, where I was her patient. These are the notes that the system she was using, which uses @OpenAI's GPT as back end, made. Wow. Thread:
188
399
144
2,227
1,412,781
Oops haven't tweeted too much recently; I'm mostly watching with interest the open source LLM ecosystem experiencing early signs of a cambrian explosion. Roughly speaking the story as of now: 1. Pretraining LLM base models remains very expensive. Think: supercomputer + months. 2. But finetuning LLMs is turning out to be very cheap and effective due to recent PEFT (parameter efficient training) techniques that work surprisingly well, e.g. LoRA / LLaMA-Adapter, and other awesome work, e.g. low precision as in bitsandbytes library. Think: few GPUs + day, even for very large models. 3. Therefore, the cambrian explosion, which requires wide reach and a lot of experimentation, is quite tractable due to (2), but only conditioned on (1). 4. The de facto OG release of (1) was Facebook's sorry Meta's LLaMA release - a very well executed high quality series of models from 7B all the way to 65B, trained nice and long, correctly ignoring the "Chinchilla trap". But LLaMA weights are research-only, been locked down behind forms, but have also awkwardly leaked all over the place... it's a bit messy. 5. In absence of an available and permissive (1), (2) cannot fully proceed. So there are a number of efforts on (1), under the banner "LLaMA but actually open", with e.g. current models from @togethercompute, @MosaicML ~matching the performance of the smallest (7B) LLaMA model, and @AiEleuther , @StabilityAI nearby. For now, things are moving along (e.g. see the 10 chat finetuned models released last ~week, and projects like llama.cpp and friends) but a bit awkwardly due to LLaMA weights being open but not really but still. And most interestingly, a lot of questions of intuition remain to be resolved, e.g. especially around how well finetuned model work in practice, even at smaller scales.
142
902
83
5,760
1,466,504
4. Samsung bans ChatGPT from company devices Samsung has decided to temporarily ban the use of generative AI tools, such as ChatGPT, on company-owned devices and internal networks following an accidental leak of sensitive data last month.
6
66
7
303
135,740
"I'd far rather be happy than right any day" - #DouglasAdams
4
20
1,372
the arc of technology is towards simplicity. talking to a computer like we talk to a human is pretty simple. we have come a long way from punch cards to natural language, but within the paradigm of natural language, we can now go so far.
421
694
140
6,866
1,022,087
Look how quickly this little DeepMind robot gets back up after being knocked down 👀
852
1,213
4,079
9,435
6,050,577
Spectacular news! GPT4All version2 will soon have access to more AI models with NO NEED OF INTERNET after download than any other system. I will be writing an in-depth review of each local AI model and their attributes soon.
Making great progress on AutoGPT on GPT4All. Still working out bugs. The iterative power of having a free and local LLM doing tasks with out need of your input is powerful. Testing more today.
9
44
6
313
98,663
I told ChatGPT I was a baker that wanted to get into data science and (using the @noteable_io plugin) it made me a notebook with EDA, Viz, ML and Further Reading. And it explained every line of code and told me how it worked using baking metaphors. It's gonna change everything.
6
31
4
160
31,515