Beruflich Dokumente
Kultur Dokumente
March 9, 2013
A quick primer on
is:
The global marketplace we make together.
is:
The premier destination for handmade goods, vintage items, and craft supplies.
simplertimestoys
lacklusterco
norwesterseaglass
quick facts:
22+ million members 800,000+ active shops
18+ million items currently for sale 20 cents to list item, 3.5% transaction fee 400+ employees (majority in Brooklyn)
Since opening its doors in June 2005, Etsy has grown virtually non-stop.
$1,000 $800 $600 $400 $200 $0
2005
2006
2007
2008
2009
2010
2011
2012
A nice problem to have: Our site is so successful, how can we move fast enough to keep up with demand?
CONTINUOUS DEPLOYMENT
:
The Early Years
(2005 - 2008)
7. Go back to step 2
WATERFALL!
:
Today
: Today
: Today
1. Small changesets
: Today
And not just engineers, but also: Designers Product Folks Upper Management Board Members Dogs
: Today
1. Small changesets 2. Engineers deploy
: Today
1. Small changesets 2. Engineers deploy 3. Deploys are fast
: Today
1. Small changesets 2. Engineers deploy 3. Deploys are fast 4. Changes behind ags
: Today
1. Small changesets 2. Engineers deploy 3. Deploys are fast 4. Changes behind ags 5. Copious graphs/metrics
: Today
This isnt license to break stu, quickly.
Engineer-driven QA and solid unit testing are integral parts of the process.
: Today
1. Small changesets 2. Engineers deploy 3. Deploys are fast 4. Changes behind ags 5. Copious graphs/metrics 6. Fix fast & roll forward
Then:
1. Weeks writing code 2. Painful merge 3. Hand o to deployers 4. Deploy, site down 5. Roll back deploy 6. Fix bugs, go to step 2
Now:
1. Small changesets 2. Engineers deploy 3. Deploys are fast 4. Changes behind ags 5. Copious graphs/metrics 6. Fix fast & roll forward
Before:
N=1 P = 0.5 S = 0.7 T = 100
Now:
N = 250 P = 0.1 S = 0.05 T = 5
E.D. = 35
E.D. = 6.25
Big Takeaway
Etsy circa 2013 (400+ employees) acts, in some ways, more like a startup than Etsy circa 2008 (40+ employees).
http://etsy.me/continuous-experimentation
Continuous Experimentation
1. Small changes 2. Run experiment (A/B test) 3. Analyze data 4. Re-examine assumptions
Heard since 2010: Neat experiment, but this will never scale.
Fun Fact:
Continuous Deployment is a fantastic recruitment tool for attracting engineers who like to move fast and get stu done.
Learn more: http://codeascraft.etsy.com/ Etsy open source (Deployinator, StatsD) http://etsy.github.com/ Join the fun: http://www.etsy.com/careers