@emmatyping@hachyderm.io (@ethanhs) profile picture

@[email protected]

@ethanhs

Former quantum compiler engineer. Part of the @mypyproject core team. @emmatyping@hachyderm.io

 Berkeley, CA
Joined December 2016
  • Tweets1.6K
  • Following486
  • Followers515
27Media
Photo by @emmatyping@hachyderm.io (@ethanhs)Photo by @emmatyping@hachyderm.io (@ethanhs)Photo by @emmatyping@hachyderm.io (@ethanhs)Photo by @emmatyping@hachyderm.io (@ethanhs)Photo by @emmatyping@hachyderm.io (@ethanhs)Photo by @emmatyping@hachyderm.io (@ethanhs)Photo by @emmatyping@hachyderm.io (@ethanhs)Photo by @emmatyping@hachyderm.io (@ethanhs)Photo by @emmatyping@hachyderm.io (@ethanhs)Photo by @emmatyping@hachyderm.io (@ethanhs)
New preprint out with colleagues from MIT! "Striped Attention: Faster Ring Attention for Causal Transformers" arxiv.org/abs/2311.09431 We introduce a simple extension to the recent Ring Attention algorithm for distributed long-context attention, and see speedups up to 1.65x! 1/
Speedup plot from the Striped Attention paper, showing up to 1.65x speedups over Ring Attention at sequence lengths >750k

ALT Speedup plot from the Striped Attention paper, showing up to 1.65x speedups over Ring Attention at sequence lengths >750k

Performance plot from the Striped Attention paper, showing roughly 40% improvements in end-to-end training throughput at a sequence length of 256k

ALT Performance plot from the Striped Attention paper, showing roughly 40% improvements in end-to-end training throughput at a sequence length of 256k

5
13
2
69
15,415
Day 2 of @AllThingsOpen — let's go! 😎 Don't miss @ethanhs at 3:45pm ET as he explains how Taking Python to the Client(side) enables experimentation in ways a traditional web app would not.
Image from Sentry (@sentry)
2
10
"No way to prevent this", say programmers of only language where this regularly happens
19
439
19
1,697
I'm genuinely excited by this CPython plan: The idea is to generate the bytecode dispatch loop out of a DSL that describes the stack effect and semantics of bytecodes: github.com/python/cpython/is…
Generate the interpreter · Issue #98831 · python/cpython

Generate the interpreter · Issue #98831 · python/cpython

Overview Over in faster-cpython/ideas we've been exploring the idea of generating the interpreter from a set of instruction definitions. This will eventually enable having multiple versions of ...

github.com
4
17
2
75
Python 3.12 will add support for the Linux perf profiler! 🔥🔥 Perf is one of the most powerful and performant profilers for Linux that allows getting a ridiculous amount of information such as CPU counters, cache misses, context switching and much more. 🧵👇
13
179
14
1,121
h/t @ethanhs: “Compiler engineers can have one (1) semantic, as a treat”
1
3
We're excited to have Ethan Smith (@ethanhs), Software Engineer for @getsentry, presenting "Taking Python to the Client(side)" at #AllThingsOpen! 2022.allthingsopen.org/sessi…
On the left, dark grey background with light grey sunbeams behind Astro standing in clouds with hearts around their head. Ethan Smith's headshot on the right. Text reads: ATO 2022. 10 years. October 30 - November 2. Raleigh, NC USA. 2022.allthingsopen.org. Featuring Ethan Smith. Software Engineer, Sentry

ALT On the left, dark grey background with light grey sunbeams behind Astro standing in clouds with hearts around their head. Ethan Smith's headshot on the right. Text reads: ATO 2022. 10 years. October 30 - November 2. Raleigh, NC USA. 2022.allthingsopen.org. Featuring Ethan Smith. Software Engineer, Sentry

2
5
Me: Aha! At last, my complex, intricate design of types with crazy complicated lifetime annotations is finished. Rust compiler, now compile my art! The Rust compiler:
Image from Pablo Galindo Salgado (@pyblogsal)
2
10
NEXT WEEK! I'll be hosting the virtual side of @getsentry's DEX conference -- here's details and the things you'll want to know -- youtu.be/MD5y4UqpsQ4
sentry DEX 2022 (remote + in-person conference)

sentry DEX 2022 (remote + in-person conference)

I will be hosting the virtual-side of sentry's developer experience...

youtube.com
1
4
18
I am once again asking for you to buy everyone webauthn tokens instead of spending money on phishing exercises
3
42
5
237
nftables sounds like a cryptobro "firewall on the blockchain" startup scam
3
13
Pharmacy partners CVS and Walgreens have already started loading appointments for bivalent (or "updated") boosters and make it easy to book a COVID-19 booster and flu shot at the same time. walgreens.com/findcare/sched…
Image from Benjy Renton (@bhrenton)
Image from Benjy Renton (@bhrenton)
1
28
2
49
a popular myth is that people who are Very Computer have computers that work. nothing could be further from the truth. the Very Computer are capable of generating much more novel and fascinating ways to make computers not fucking work and exercise this capability wantonly
255
5,645
841
23,404
Replying to @DecibelOverkill @abunnybee @ManishEarth
Rust has a very strong type system
Image from SLEFFY (@DecibelOverkill)
1
3
19
After a very long time and hundreds of github comments, the WebAssembly Garbage Collection subgroup finally agreed on how to handle non-nullable locals. This is a pretty big milestone, and great progress towards a final wasm GC spec! 1/4
3
31
4
203
Amazing! New Apple iOS feature called “Lockdown” Instantly Rewrites OS in Rust to Eliminate Memory Unsafety Issues
1
1
7
Oh wow, that's huge! Python 3.15 will switch to UTF-8 by default for everything (files, stdio, pipes, etc.) with PEP 686: peps.python.org/pep-0686/ INADA-san @methane is working for many years towards this long term goal (October 2025).
4
17
90
so i took the cover of my mattress off to wash it and now there’s FIBERGLASS DUST everywhere catastrophic failure mode for something that has a zipper and not a single warning label for you not to do it i need help and i don’t know what to do… it’s like midnight and this sucks
4
4
1
15
📣 State of WebAssembly 2022 Survey I'd like to invite you all to share your views on WebAssembly and the wider wasm ecosystem forms.gle/BUmTpKWBdux4TAsWA
State of WebAssembly 2022 Survey

State of WebAssembly 2022 Survey

WebAssembly is a new and exciting technology that was ‘born’ in the browser, but is now making waves more widely. We’d love to know more about where you’re using this technology, how you’re using it...

docs.google.com
4
31
4
42
Mypy 0.960 is out, with many improvements and fixes! mypy-lang.blogspot.com/2022/…
5
5
Load more