Sergio Freire retweeted
Is Chain-of-Thought Reasoning of LLMs a Mirage?
... Our results reveal that CoT reasoning is a brittle mirage that vanishes when it is pushed beyond training distributions. This work offers a deeper understanding of why and when CoT reasoning fails, emphasizing the ongoing challenge of achieving genuine and generalizable reasoning.
... Our findings reveal that CoT reasoning works effectively when applied to in-distribution or near
in-distribution data but becomes fragile and prone to failure even under moderate distribution shifts.
In some cases, LLMs generate fluent yet logically inconsistent reasoning steps. The results suggest that what appears to be structured reasoning can be a mirage, emerging from memorized or interpolated patterns in the training data rather than logical inference.
... Together, these findings suggest that LLMs are not principled reasoners but rather sophisticated simulators of reasoning-like text.
Sergio Freire retweeted
OpenAI has released a guide on how to finetune their open-source models:
cookbook.openai.com/articles…
Sergio Freire retweeted
Comprehensive Taxonomy of LLM Hallucinations
Nice report covering common hallucinations, root causes, and mitigation strategies.
Sergio Freire retweeted
My collaboration with Sauce Labs has ended after over six years. 🥺
Sauce was the first West Coast tech company I ever worked with, and it has been my best experience with any organization. I felt warmly welcomed and accepted, and I have memories that will last a lifetime. I learned a great deal and built many unique relationships along the way.
I want to thank my fantastic team members: @titusfortner , @diegofmolina , @mmerrell , and @pcultural . I am also thankful to my manager, @JasonEBaum1 , and to Titus, Terri Avnaim, and Manuel Ruiz for bringing me to Sauce.
A big thank you to all the wonderful contributors on the marketing and go-to-market teams. Overall, I am incredibly grateful for my entire experience.
I will take some time to decide what to do next, as I have some exciting ideas in mind. 😉
Feel free to reach out to me with any business opportunities!
Sergio Freire retweeted
All flights grounded nationwide? After 2 hrs on the tarmac we had to deplane, this red eye flight just got a lot longer with no end in sight. #Crowdstrike – at SeaTac, WA
Sergio Freire retweeted
You cannot miss this talk from my colleague Ana Duarte about test documentation practices!
While you are there come and talk to Ana and us in the @XrayApp booth.
🚀 Join Ana Duarte at #AutomationSTAR for "Test Documentation: Why So Technical?" Discover how to simplify and improve your test documentation practices. Don't miss out on this valuable session! Book your tickets now! 🌟 shorturl.at/cyIBl #Vienna2024 #TestAutomation
Sergio Freire retweeted
Do you know @darktelecom ? Today we have turned the tables and the guest is the therapist :) Curious about his journey and other secrets unveiled? Check it out then!
I landed in #testing many years ago (really?). In this #QATherapy podcast episode I share a bit of my journey and also some stories and findings along the way. Give it a listen :)
open.spotify.com/episode/5a2…
#quality #softwaretesting #development
Sergio Freire retweeted
🚀 Discover new testing methods! See how the Xray Exploratory App improves scenario-based, strategy-based, and freestyle testing. Go beyond session-based testing! Read more: hubs.li/Q02CMV9H0
#Testing #QA #XrayExploratoryApp #SoftwareTesting
Sergio Freire retweeted
Hey everyone! I'm excited to invite you to @zappletech 's Test Automation Meetup on June 26th! I'll be sharing insights on how to effectively manage the tooling avalanche.
More info here:
zapple.tech/meetups/meetup-j…
Sergio Freire retweeted
Today, with Chris Armstrong, dive deep into risk-storming and adopting a risk-based approach in your projects, where testing plays is key 🔑.
🔗 Tune in: hubs.li/Q02xGj_K0
#PerformanceTesting #SoftwareOptimization #QATherapy
Sergio Freire retweeted
🕵️ This Wednesday, the 15th of May, the fantastic @darktelecom will be live with a free webinar, hosted by the one and only @gwendiagram!
We'll be streaming to LinkedIn and YouTube - register now and mark it on your calendars
buff.ly/4dt30z3
Sergio Freire retweeted
Replying to @darktelecom
@darktelecom will focus on performing testing as humans to uncover unknown risks in our products at our next webinar, Human-Centric Exploratory Testing by @XrayApp
Join us for free on the 15th of May at 5 PM (BST) 👇
buff.ly/3y4irNW
Sergio Freire retweeted
🚀 Unlock the power of Exploratory Testing with our latest article! 🕵️♂️
Explore the unknown, uncover insights, and elevate your testing game today! 🔍💡
Read more: getxray.app/blog/how-to-over…
#SoftwareTesting #ExploratoryTesting #XrayExploratoryApp
Sergio Freire retweeted
Mark your calendars for January 25th! Don't miss out on the Quality Horizon by @KatalonPlatform, where @darktelecom dives into "The Holy Grail of Testing: Have we found it?". Save your spot here 👉 katalon.com/webinars/quality…
Sergio Freire retweeted
When last did you utilise user personas? Could yours do with an update to get better insights into your testing? Get some ideas from our annual partner @xrayapp's post
🔍 Improve #ExploratoryTesting with user personas. Our latest blog explores how this approach unlocks deeper insights and better quality. Tailor your testing to real-world scenarios and diverse user needs.🌐 hubs.li/Q02bVtqT0
#QualityAssurance #XrayExploratoryApp
Sergio Freire retweeted
A message from @XrayApp: Want to free your creativity during #exploratorytesting? 🧭 With Xray Exploratory App, you use critical thinking to cover untested code, discover new scenarios, and find hard-to-catch bugs. 👉Start for free today!
Sergio Freire retweeted
Make critical thinking a foundational subject in education. Teach students how to think critically, analyze information, and discern fact from fiction using scientific methods, creating a more discerning and informed society.





























