David Singleton’s Post

View profile for David Singleton, graphic

CTO at Stripe

We've just shared our annual letter, including how we engineer for reliability as we deploy new code in our core API services ~400 times daily at trillion dollar scale: - Once a change is code-complete, it's evaluated by ~1.4 million tests. (Stripe uses half a million CPU cores to execute <6 billion test runs daily!) - Changes first go to pre-production (a mock production environment with synthetic API traffic designed to mimic realistic integration patterns). - The change then rolls out to a single production machine with a small sliver of traffic, before gradually advancing to small percentages of actual production traffic. Each deploy is inspected against 55,000 different metrics. If at any moment the system detects something is wrong—traffic is redirected to an older, known-good version of Stripe. Read more in the letter: https://lnkd.in/g-Zn9GtZ.

Luke Gee

Senior Engineering Manager at Origami | Opinions expressed on here are solely my own and are probably nonsense. Remote Working based in Cornwall

8mo

"Once a change is code-complete, " Id be dead interested in what processes come before changes hit the evaluation pipelines at your scale. Do your teams practise continuous delivery, CI , TBD (assuming something close with 400 daily changes) etc and how that has impacted your reliability measures etc

Like
Reply
Brenden Grace

ƒ(cto): Fractional technology acceleration

8mo

"Changes first go to pre-production (a mock production environment with synthetic API traffic" We implemented this at one company I worked for, and it created a massive boost in developer productivity and production stability. It caught many difficult-to-test issues that were headed to production. It can be an expensive investment, but in a situation where every transaction is critical and the stack has become complex, it is a worthwhile investment.

Husien Vora

AI & Web3 Specialist | Startup Ecosystems Innovator | Collaborator with YC-backed Founders

8mo

As a software engineer this is inspiring and as a user feel much more safer using stripe, keep it up 👍

Neetish Raj

Cloud Architect | Founder PropsCover | Training | Recruitment | Fractional CTO

8mo

It ll take me a team of expert cloud consultants, DevOps professionals specialising in orchestration, & few Test Infra experts just to digest these massive numbers - 500,000 CPU cores - 1,400,000 tests ( no ones gonna ask code coverage) - 6,000,000,000 Test runs daily These are mind blowing numbers and difficult to fathom the sheer scale of this testing and release infrastructure.

Leandro Maia

Director of Engineering | Engineering Leader

7mo

Apart from being best practice to test things, how do you calculate ROI of reliability cost vs infrastructure cost? assuming such infrastructure at this scale is not cheap, do you have a metric for that?

Like
Reply
Muhammad Abubakar

Appointment Setter / Lead Generation | Market Research Analyst

7mo

Hi I would like to introduce three exceptional candidates whom I believe would be valuable assets to your team and contribute significantly to the success of your company. While I have refrained from attaching their resumes to keep this initial communication short and concise, I would be more than happy to provide detailed CVs upon your request.

Like
Reply
Kim-Ha Ho

Bringing Equanimity to your Operation | Finance & Strategy | Nonprofit Advisor

8mo

I am loving this trending of companies posting their annual letters on social media! It is an effort to include (and if you think about it, INVITE!) business prospects to see the journey that makes the company. Great initiative Stripe 🥳 👏.

Like
Reply
Nancy Collins

Founding member | Project Management Specialist I Business Management | Leading the QA testing space | Helping companies overcome product release & efficiency struggles

7mo

how many testers/headcount is required to achieve such large activity?

Like
Reply
Gopi Krishna Lakkepuram

Hyperleap AI | ISB - MBA | Ex-Microsoft (Office 365)

7mo

No wonder, why stripe just works. every. single. time.

Like
Reply
Kamil Wozniak

TMIET ● Full-Stack Developer & Architect ● People-Focused Leader ● Software Engineer with broad experience ● Certified Professional Cloud Architect ● Developer advocate

7mo

Thank you for sharing David Singleton

Like
Reply
See more comments

To view or add a comment, sign in

Explore topics