I-regex yehlise i-Cloudflare. Imizuzu engu-27.

Lokho okuhlanganiswa yile vidiyo

• 13:31–13:42 UTC: I-PR ihlangene, i-CI eluhlaza (ayikho i-CPU test), i-Quicksilver iphusha umthetho emadolobheni angu-180+; imithetho ye-WAF yeqa izigaba ze-DOG → PIG → Canary
• 13:45–14:07: ikhasi lokuqala; i-CPU u-100 % emhlabeni wonke, ukuhamba kwedatha −82 %, u-502s yonke indawo; iphaneli yokulawula yangaphakathi isemva kwe-Cloudflare Access, eyehlile; amanye amakhredithi aphelelwe yisikhathi; indlela yokudlula engavamile ukufundwa
• 14:07–14:09: ukuqedwa kwe-WAF emhlabeni wonke; ukuhamba kwedatha ne-CPU kujwayelekile ngemuva kwemizuzu engu-27; 14:52 I-WAF ibuyile ngaphandle komthetho
• Jul 2 (15:50 UTC) no-Jul 12: I-Cloudflare ishicilela inothi losuku olufanayo kanye nokuhlola okuphelele ngemuva kwesigameko; i-CPU guard yengezwe kabusha, imithetho engu-3,868 ifundwe kabusha, ukusakazwa ngezigaba, ukudlulela kwinjini ye-regex yesikhathi esiqondile

Umbhalo obhaliwe ohunyushwe

Kuhunyushwe kusuka ekulandiseni kokuqala kwesiNgisi. Umsindo namazwibela atholakalayo alawulwa yi-YouTube.

0:00 Isisho esisodwa esivamile siqala ukusebenza kuyo yonke iseva ye-Cloudflare ngesikhathi esisodwa, futhi imizuzu engamashumi amabili nesikhombisa elandelayo izindawo ezisemva kwayo ziyikhasi elingu-502, okungukuthi, ngesikhathi sokuvikela, isilungiselelo esiqine kakhulu esingenzeka. Julayi 2, 2019, 13:42 UTC. I-Cloudflare ithumela kungakapheli amahora amabili: akulona uhlaselo, ukusatshalaliswa okubi, ukuhamba kwedatha kwehle ngo-82 ekhulwini. Ezinsukwini eziyishumi kamuva u-CTO John Graham-Cumming ushicilela ukuhlola okuphelele ngemuva kwesigameko, i-regex ifakiwe, futhi i-Hacker News iyanikeza amaphuzu angu-698,

0:26 okungukuthi uma kuphazamiseka kuyisikhathi sokubonga. Ukuthi kwenzeka kanjani, kungani kungenzeka, nokuthi ubani ngempela ohluleka. Lolu The Daily Diff, postmortem. 13:31. Isicelo sokuhlanganisa sihlanganiswa: umthetho omusha owodwa wokuvikela i-cross-site scripting, ngemodi yokulingisa, ngakho ayivimbi lutho. 13:37, izivivinyo ziyaphumelela; akukho okuqapha i-CPU. 13:42, umthetho uthunyelwa emadolobheni angu-180 ngemizuzwana emibili, ngoba imithetho ye-WAF yeqa izigaba zenja, ingulube nenyoni ezinye izinto ezikhishwa ngayo.

0:54 13:45, ikhasi lokuqala. 13:49, i-Hacker News inentambo ngesimo sekhasi, okusho namanje ukuthi zonke izinhlelo ziyasebenza. Umthetho uphela ngo-dot-star, dot-star, equals, dot-star: noma yini, bese noma yini, bese uphawu lokulingana. I-PCRE iqagela ngokuhaha, yehluleka, bese ibuyela emuva kuzo zonke ezinye izingxenye. u-x olingana no-x uthatha izinyathelo ezingu-23. Ama-x angamashumi amabili ngemuva kokulingana: 555.

1:15 Ama-x angamashumi amabili, ayikho uphawu lokulingana: izinyathelo ezingu-4,067 zokuthola lutho. Yisebenzise kuso sonke isicelo futhi yonke i-core iba kumakhulu ekhulwini, ingenza lutho, ngokuphelele. Izimbali ezimbili bekumele ziyibambe. Umkhawulo we-CPU emithethweni wasuswa ngephutha emasontweni ngaphambili, ekuhlelweni kabusha okuhloswe ukwenza i-WAF isebenzise i-CPU encane. Futhi inqubo ivumela noma yimuphi umthetho ukuthi weqe isiteji, ngoba imithetho ikhona ukuze imise ukuhlasela okusebenzayo, lokhu kwakungesona isimo esiphuthumayo, futhi kwahamba emhlabeni wonke noma kunjalo.

1:37 14:00, i-WAF ikhomba; akukho ukuhlasela. 14:02, omunye uhlongoza ukuqedwa komhlaba wonke: into eyodwa, ivaliwe, emhlabeni wonke. Inkinobho isemva kwe-Cloudflare Access. I-Cloudflare Access isemva kwe-Cloudflare. Amanye amakhredithi aphelelwe yisikhathi ngenxa yokungasetshenziswa, ngakho inethiwekhi esheshayo ku- inthanethi ichitha imizuzu emihlanu endleleni yokudlula okungazange kwenzelwe muntu. 14:07, yibulale. 14:09, ukuhamba kwedatha kujwayelekile. git blame: ukukhishwa ngesivinini esisodwa, emhlabeni wonke; i-CPU guard ehlukaniswe ngephutha;

2:04 injini ye-regex engenamkhawulo ophezulu. Hhayi unjiniyela owabhala umthetho: ukuhlola ngemuva kwesigameko kubala izimbangela eziyishumi nanye kanye amagama akekho. Ukusabalala kokulimala: imizuzu engu-27, u-82 ekhulwini wokuhamba kwedatha, u-100 ekhulwini we-CPU kuyo yonke i-core, kuyo yonke idolobha. I-dashboard ne-API kusemuva kwe-edge efanayo, ngakho amakhasimende awakwazi ngisho nokucisha yona. I-Hacker News, ngaphansi kokuhlola ngemuva kwesigameko: babenenkinga eyodwa, basebenzisa isisho esivamile, manje banezimbili. Ihlaya elidala. Lisahlanganisa.

2:28 Isinqumo, ngemuva kwesigameko: SHIP IT. I-CPU guard ibuyile, yonke imithetho engu-3,868 ifundwa ngesandla, imithetho idlula esiteji, futhi injini idlulela kwinjini enezikhathi zokuqondile izikhathi, eshicilelwe ngu-Ken Thompson ngo-1968. NgoMsombuluko: akukho dot-star dot-star kunoma yini esebenza ngokwesicelo, futhi gcina inkinobho yokucisha ingekho entweni eyibulalayo. Ngithumele isigameko ongakavunyelwa ukukhuluma ngaso, kumazwana, noma ku-the daily diff dot dev.

2:53 Futhi lowo umehluko wanamuhla. Ngingu-Niko wase-Axrisi. Hlanganisa ngokuzibopha.

Imithombo

1. John Graham-Cumming, "Details of the Cloudflare outage on July 2, 2019" (Jul 12, 2019)blog.cloudflare.com
2. Matthew Prince, "Cloudflare outage caused by bad software deploy (updated)" (Jul 2, 2019)blog.cloudflare.com
3. Matthew Prince on X, Jul 2, 2019, 14:22 UTCx.com
4. Matthew Prince on X, Jul 2, 2019, 14:36 UTC ("No evidence yet attack related")x.com
5. Hacker News, Jul 2, 2019, 13:49 UTC — "Cloudflare Network Performance Issues" (631 points)news.ycombinator.com
6. Hacker News, Jul 2, 2019 — "Cloudflare outage caused by bad software deploy" (348 points)news.ycombinator.com
7. Hacker News, Jul 12, 2019 — "Details of the Cloudflare outage on July 2, 2019" (698 points)news.ycombinator.com
8. TechCrunch, Jul 2, 2019techcrunch.com