Navjot (@_navjotts_) header
Navjot (@_navjotts_) profile picture

Head of Applied AI Research @ Firefly Enterprise. Past: Founding ML & LLM R&D at @cresta. Co-founded Doculus, acquired by Box. Alum Maths & Comp @IITKgp.

San Francisco, CA
Joined November 2014
Photo by Navjot (@_navjotts_)Photo by Navjot (@_navjotts_)Photo by Navjot (@_navjotts_)
Navjot retweeted
Congrats to the @cresta team on its next chapter with @salesforce. Read more about the journey here: sequoiacap.com/article/crest…
Big news: We've entered into a definitive agreement to be acquired by @Salesforce! We built Cresta to make great customer experiences an unlimited resource through a single AI operating system for customer experience. Today marks a major step forward in that journey. Together, we see an opportunity to realize that vision at scale with Cresta complementing Salesforce’s first-class customer service platform. More: salesforce.com/news/stories/…
5
6
3
86
14,142
Most takes on RL environments are bad. 1. There are hardly any high-quality RL environments and evals available. Most agentic environments and evals are flawed when you look at the details. It’s a crisis: and no one is talking about it because they’re being hoodwinked by labs marketing their models on flawed evals. 2. Even the best public RL environments and agentic evals suck, and usually can’t be used by labs without modification. Academics often publish-and-forget instead of doing the necessary follow-up work to make the envs/evals useful for labs. 3. The best person to make an environment is someone deeply knowledgeable about a field, not a high-level generalist or newbie - 🦔 not 🦊 - but most envs are being made by generalists or low-skill contractors. 4. People are too focused on whether a problem is verifiable or not, not what kind of capabilities they want to bring into being. We don’t need more math and puzzle environments. The usefulness of an environment is proportional to its difficulty of construction. 5. Saying you want to “scale RL environments” is as meaningless as “scale is all you need” in that it says nothing about your choice of what to scale. 6. People are treating RL environment scaling as a new type of pretraining (creating a new internet), but pretraining has extremely high diversity, and expecting a single company (or collection of companies) to replicate this diversity is unrealistic. That means generalisation will be slower to emerge than the previous paradigm - and so there is more leverage in choosing which environments to build first. If you’d like to help answer the right questions in this new space, join us at @GenReasoning.
31
47
9
702
111,944
Heading to @kdd_news where we'll be presenting our work on evaluating LLMs for factuality when analyzing conversation transcripts (github.com/cresta/fect) and @cresta is sponsoring AI Reasoning Day! @_navjotts_, @DalalBinoy, and many other wonderful Crestans will also be there. Come talk to us to hear about the cutting-edge work Cresta is doing in enterprise generative AI!
2
1
4
545
Very excited to have Cresta as a user of agent reinforcement trainer (ART)! Cresta is AI-native and has a large, sophisticated ML team. ART isn't just easy to get started with, but also very powerful!
Replying to @corbtt @bradhilton
Fantastic work y’all. We’ve been using your platform extensively at cresta especially for the email RL project and it’s been fun!
2
4
18
2,718
You don’t need a PhD to be a great AI researcher. Even @OpenAI’s Chief Research Officer doesn’t have a PhD.
184
191
104
3,347
1,297,877
Cresta's been deploying finetuned GPT in production since 2019. cresta.com/blog/action-direc… We are ramping up LLM effort to build the most advanced conversational agent. Join us at: linkedin.com/jobs/view/37017… Some ML areas we are excited about: - domain foundation models leveraging instruction finetuning and RLHF - zero-shot and few-shot learning for complex semantic concepts - retrieval augmented generation - low-latency LLMs for real-time copilot. - reward modeling and conversation-level outcomes.
1
3
731
At @cresta, we found "How do I use ChatGPT to transform business?" has become the top question Fortune 500 CEOs ask. How to use ChatGPT to run diagnostics on millions of conversations at scale 🧵👉 cresta.com/blog/how-to-use-c… #GenerativeAI #ChatGPT #ContactCenter #LLM
1
3
4
1,779
A recent trend is to fine-tune open-source LMs on ChatGPT outputs (e.g., Alpaca, Self-Instruct, Vicuna), with the aim of broadly imitating the model. In our new paper, we critically analyze this approach. arxiv.org/abs/2305.15717 👇[1/N]
21
81
18
486
187,100
New Post: Sharing some thoughts on the emerging tech stack of generative AI. LLMs != AI System != AI Product Thin wrappers are being built every day, but are they sufficient for vertical SaaS applications? Let's unpack 👉🚀 @cresta #GenerativeAI #GPT4 cresta.com/ai-innovation/the…
6
38
5
124
29,092
amazing work by cresta team @mennen_lars @_navjotts_ . the community now can serve instruction tuned LLMs on a single G5 instance with no performance degradation!
What a contribution from @mennen_lars & @_navjotts_ You can now load and use flan-t5-xxl and flan-t5-xl in 8bit with no performance degradation 🔥 The PR for the fix: github.com/huggingface/trans…
1
3
1,007
An interesting historical note is that neural language models have actually been around for a very long time but noone really cared anywhere near today's extent. LMs were thought of as specific applications, not as mainline research unlocking new general AI paths and capabilities
37
173
13
1,209
Navjot retweeted
To scale as an #AI software company, we strive to accelerate our speed to develop and iterate our ML models. In this blog post, @_navjotts_ shares how our classification pipeline has evolved and how we reduced our labeling cost and efforts by over 10x. cresta.com/blog/how-we-reduc…
10
17
Navjot retweeted
Think about the last time you taught someone something difficult. Did you tell them what to do, or did you show them how it’s done? @timshi_ai explains the ethos behind Cresta's AI and how we teach contact center agents to perform like experts. #ai cresta.com/blog/software-tha…
4
8
Navjot retweeted
☎️Wondering how contact centers are driving business continuity and preserving customer experience during COVID-19? Join Cresta and industry leaders from Cox, Intuit, Sleep Number, and TTEC to find out. cresta.com/talks/covid-19/ #remoteworkforce #WFH #cx #contactcenter #crestaAI