Same here in Germany. Gmail says that my account can not be found. Plus Google&#x27;s support page is also down

Yeah, drive and youtube seem to be down as well

Drive too. Status board still green though.

Yes, I can confirm this. I got an error when accessing Google Docs, Google Meet, and Gmail.

Alors, Search queries taking up to 3 seconds here in France.

Anyone else has this in the technical details?
Numeric Code: 7444

Pretty much anything that requires login is broken.

It works 99.9% of the time, good enough eh?

What if it is a static website of corporate propaganda?

It works fine. You can&#x27;t login only.

The status page has proven itself useless again. According to that page, everything is working perfectly fine.

Hungary - gmail loads, can&#x27;t send email (error #2014)

Can confirm from Germany, youtube is broke.

Google should write an AI application that checks on HN if their systems are working and display the result live on their status page. That would be more reliable than the current system they have in place (which is obviously not working at all).

Seems like everyone going on HN now. The site is so slow

For many others it seems: <a href="https:&#x2F;&#x2F;i.ibb.co&#x2F;ns8DgGq&#x2F;Screenshot-2020-12-14-at-12-10-17.png" rel="nofollow">https:&#x2F;&#x2F;i.ibb.co&#x2F;ns8DgGq&#x2F;Screenshot-2020-12-14-at-12-10-17.p...</a>

I, and probably many others here are like a status page for friends and family too... I had my wife thinking that the internet was broken, and tried tethering to phone and things and still didn&#x27;t work, then showed me and I saw the status code errors and was like &quot;it&#x27;s actually parts of Google that are down&quot;.I love (and am deeply scared by) the dependence of Google and the confusion of it with the entire internet.

There are other sites that can check for you

HN is my goto status page when these things happen, never failed to provide up-to-date reliable information.

This is not true. i am logged in to gmail and getting 500 erredit:parent updated comment

Are you saying the Google status page is correct then? Being logged in is part of being green I’d think.Also, you can’t use many parts of Gmail, Drive, Photos, etc, without being logged in.

Try YouTube, which is totally broken.But I guess it&#x27;s technically not part of &#x2F;appsstatus

Google made everyone get an account trying to force Google+ on to everyone. They don&#x27;t get to pretend like that didn&#x27;t happen by not factoring it into their status.

It is all green if you do not need to be logged in.If you are logged in, the page crashes with an error.You can still browse all services from Incognito (which for some is not an option).

<a href="https:&#x2F;&#x2F;downdetector.com&#x2F;search&#x2F;?q=google" rel="nofollow">https:&#x2F;&#x2F;downdetector.com&#x2F;search&#x2F;?q=google</a> shows all the Google services and seems like everything other than search is reporting errors

Amusingly, downdetector.com is now down. Gotta love that cascade effect :-)

Found this relatively recently, seems to do a good job.Do love how more consumer services (ISPs &amp;c) always have some report of being down somewhere but its means nothing unless there&#x27;s a big spike.

<a href="https:&#x2F;&#x2F;downdetector.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;downdetector.com&#x2F;</a> is remarkably good at catching this too.But funnily enough, a lot of the votes come from traffic that searches for &quot;is ____ down?&quot; on Google. XD

Pretty funny. I would normally assume they are connected to some testing unit that real users interface with. Vs internal APIs or however Google is doing this with them still being green

It&#x27;s a big group of teams... one team is responsible for monitoring (And status reporting) alone

There should be enough people on that to communicate out as well as resolve.

If they know its broken, one of the _many_ engineers&#x2F;support across Youtube+Gmail+etc that are all known to be down related to this bug should be able to update it in first few minutes. Especially if this isn&#x27;t a 5 min fix.

I&#x27;d expect within seconds that Google is alerted of a very large number of issues with their servers and that the status page would be updated (the green light going to red) within seconds. It&#x27;s now quite some time after the start of the outage and everything is still green on that status page.

I&#x27;d expect that status page to be automated based on a number of metrics &#x2F; health checks.  Our equivalent is.

&gt; what response time do you expect on a page like that?Faster than a free third-party website’s response time. Google should know they are down and tell people about it before Hacker News, Twitter, etc. Google should be the source of truth for Google service status, not social media.&gt; And what level of detail?Enough to not tell people that there are “No issues” with services.&gt; I&#x27;d much rather have their team focus on fixing this as fast as possible than trying to update that dashboard in the first 5 minutes.Google employs enough people to do both.

How many employees do you think Google has? Do you think they&#x27;re all working on the same task?

&gt; I&#x27;d much rather have their team focus on fixing this as fast as possible than trying to update that dashboard in the first 5 minutes.It&#x27;s not like they would be working on the status page right now, that work should have been done a long time ago...

It should be faster than it takes TechCrunch to write an article about it

Out of curiosity, what response time do you expect on a page like that? And what level of detail? I&#x27;d much rather have their team focus on fixing this as fast as possible than trying to update that dashboard in the first 5 minutes.

Especially one that breaks the back button.

Customer confidence. Same as how everyone reports they have 99.99% uptime.

What&#x27;s the point of having a status page when it can&#x27;t reliably tell you the factual status?

Not true. Only for written things like postmortems. Automated systems need to be vetted but can update things like status pages on their own.The issue isn&#x27;t &quot;negative&quot; realities, it is saying something while investigating that might break contracts only to find later that it wasn&#x27;t true.

Someone here in hn said at Amazon AWS they are required direct CTO approvals to reflect negative realities. Maybe that’s the case for anyone these days.

These uptime numbers cloud providers gives out can&#x27;t be nowhere near actual uptime.

Mistakes happen... that page is probably still correct 99,9999% of the time!&#x2F;s

I don&#x27;t think it&#x27;s difficult, I think they just lie.Monitoring is very simple, I even learned this from a document released by the Google devops team many years ago.Always alert from the end user perspective. So in other words have an external server test login to Gmail. Simple as that.They manually update that status page to not scare away stockholders.

Definitely i agree with you. Although the statuses are updated later, it may cause many problems if it is not instantaneous.

It reflects the reality for them.The small print says: The problem with Gmail should be resolved for the vast majority of affected users. We will continue to work towards restoring service for the remaining affected users...At Google scale, &quot;remaining affected users&quot; probably number in tens of millions. Sucks to be one of them, tho.But hey, it happens. As a SaaS maintainer, I can sympathise with any SREs involved in handling this, and know that no service can be up 100% of the time.

Just checked <a href="https:&#x2F;&#x2F;www.google.com&#x2F;appsstatus" rel="nofollow">https:&#x2F;&#x2F;www.google.com&#x2F;appsstatus</a>all green, which does not reflect reality for me (e.g. Gmail is down)edit: shows how incredibly difficult introspection is

Google Meet and YouTube also 500 in Brazil

You are right, the YT homepage opens up in private tabs. It seems strange, I wonder might be causing this.

YouTube shows a &quot;something&#x27;s broken&quot; error. Similar errors when trying to access Gmail. Tried on multiple browsers and connections, got the same result. The search engine works fine, as of now.

Same here, can&#x27;t access gmail (currently on a trip in Poland).

Yep. Gmail redirects to Gsuite Status Control and shows everything as fine there.

Everything is back and working fine now, here.

Thanks for the tip! Several people said its related to logins&#x2F;auth so this helps getting access to videos&#x2F;info.maybe this is their fingerprinting&#x2F;cookies&#x2F;tracking server side logic has some bug that is failing?

I can access youtube if I&#x27;m not logged in (Incognito)

Can&#x27;t access my files on Google Drive, shit.

Google still is the best when it comes to search. But its also important to know the alternatives. You will be surprised how many people dont know Google alternatives. lol

Search is still working. It’s Drive, Meet, and other stuff that millions of people depend on for work, so maybe stow your glee for a moment.

Good. Now, at least a few people would search Google alternatives in DDG

I&#x27;m able to access GMail and Maps but not Youtube or Drive.

Gmail, Chat and Meet down from Italy as well, was in a Meet call and got disconnected, only getting 500s across all three now

Sweden. The same problem. Authorization doesn&#x27;t work. Gmail doesn&#x27;t work.

as another user mentioned, they work in incognito. looks like there is a problem with google auth which is causing the outage

Can verify - India. Gmail, Drive, Docs, Youtube not working.

All down for me, Serbia. YouTube works for me when logged out (i.e. in Incognito).

Wow, I&#x27;m glad there are a few things that I do that don&#x27;t require Google auth.

Same, my work mail does not work. I was supposed to be in a meeting right now.

That&#x27;s why my Thunderbird constantly popped up to enter my Google Mail credentials…

Gmail, Calendar, Google Accounts down in Germany

Google login also seems to be affected, meaning all services using google account login are inaccessible if you aren&#x27;t logged in.

Yeah, that status page is really frustrating. Didn&#x27;t anyone consider building it to REALLY check if services were working? not just returning a 200 Status... but actually DOING things?

Yeah weird it’s all green. I just noticed things down as well. Came to HN to see how quickly people posted. This is already #1 at 6:55 am EST

The Nest endpoints are returning 500 as well.

Was wondering why youtube can&#x27;t show videos from the search page , it even reverted my language settings.South Africa

Time to stop postponing that large Google Takeout for me!

Same for me - and then I tried logging in to gmail in an incognito window and got &quot;Couldn&#x27;t find your Google account&quot; which really scared me.

This happened to me with a work email. For a moment I thought, &quot;Well, I had a good run at this company..&quot; My next thought was, &quot;Ha, Google must be down - better check HackerNews.&quot;

I am still experiencing this problem on all my synced-to-Thunderbird Gmail accounts, so it either hasn&#x27;t been completely fixed yet, or there&#x27;s another ongoing issue.

Thunderbird prompting me to login, and getting &quot;Google does not recognize this email address&quot; as a reply was a nice adrenaline spike, until I checked the status on HN!

<a href="https:&#x2F;&#x2F;console.cloud.google.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;console.cloud.google.com&#x2F;</a> is down as well. Seems very much an identity issue.

I really should try to get my stuff moved to my new address. Not self-hosted, but a non-profit that has been around for a while... Finally paid the membership fee.

Underrated comment. If the government freezes your bank account, at least you can take them to court. If Google mistakenly disables your account, there does not seem to be any legal recourse. Considering the extent to which people depend on their services, perhaps there should be a more elaborate appeal process.

For a second I legit thought Google banned my account for some reason. And I don&#x27;t like it that I feel relieved..

I started this[1] the last time something similarly scary happened.It&#x27;s very comforting to have a local copy of everything important in situations like this one.[1] <a href="https:&#x2F;&#x2F;wiki.emilburzo.com&#x2F;backing-up-your-google-digital-life&#x2F;" rel="nofollow">https:&#x2F;&#x2F;wiki.emilburzo.com&#x2F;backing-up-your-google-digital-li...</a>

Yes! It takes some work to switch, but it&#x27;s worth it. Buy your own domain name, and link it to an existing service if you don&#x27;t want to host yourself. You&#x27;ll always be able to switch your mail alias when having issues with your email host.

Our entire library of video tutorials disappeared for a while. I was not happy, and the thought of losing our email.. Currently working with the team to make backups of absolutely everything off-site and off-Google. A good wake up call for us.

Gmail said my account was &quot;temporarily&quot; unavailable... had a moment considering if it wasn&#x27;t temporary. Good reminder to remove my reliance on gmail especially.

The console for Google Cloud Platform is also down.

Youtube is up for me, but CANNOT login to Gmail

Confirmed from Spain.  Google Workspace seems to be down.

I was thinking the same thing. Also this funny bit that’s relevant:
<a href="https:&#x2F;&#x2F;entertainment.theonion.com&#x2F;google-shuts-down-gmail-for-two-hours-to-show-its-immen-1819595180" rel="nofollow">https:&#x2F;&#x2F;entertainment.theonion.com&#x2F;google-shuts-down-gmail-f...</a>
“Google Shuts Down Gmail For Two Hours To Show Its Immense Power”

Do tech companies post that kind of data?When I worked in the automotive industry, the Detroit Big 3 American auto makers had figured out their cost per minute of downtime. They would even charge that to their suppliers and anyone who shut down one of their plants.It was something like $10,000 per minute since they’re able to roll a complete vehicle off the assembly line about every minute

What do you think, how much money are they losing right now every second?

Hungary - gmail down, youtube down if logged in, search works with 5s response time

In inkognito window (without Adblock) it works for me!

This outage is an idea from Calico then? (just kidding)

let&#x27;s not make panicked drastic decisions just yet

Google Reader and Google Wave also seem to be affected.

I noticed Gmail and of course the google doc I was working on were unavailable. I didn&#x27;t come check HN until I said to my wife &quot;Google&#x27;s down&quot; when she complained her email didn&#x27;t work and she said &quot;check the news to see if Google&#x27;s really down&quot;

Yep, HN getting it&#x27;s very own HN hug of death from google

This is probably like an user flood wave, crushing all platforms in its wake. Give it 10 minutes and Reddit will be down as well :)

This wouldn&#x27;t be a problem if HN migrated to a blockchain written in go for performance

I feel like HN&#x27;s server aren&#x27;t very happy with everybody doing this though.Stop bullying the servers :(

HN was actually down for me when I first checked. I was wondering what possible infrastructure HN and youtube could have in common before it clicked

who would have thought a lot of folks here also use google products.for real, though, hacker news is getting slower every second since this thread is up. i won&#x27;t be shocked if it goes down due to the surge of traffic due to google outage

I came to HN to see if there was news to calm me down, we just started business day here, and as soon I tried to login some 30 minutes ago, Google claimed my paid business account didn&#x27;t exist, so I came here to check if there was some mass banning or something like that.

210 points in 5 minutes. 500 in 10. Seems everyone see&#x27;s the status page and is like &quot;hey, time to check hn&quot; ;-)EDIT: You can permanently refresh and see the score increase by 2-3 points each second. Wow.EDIT 2: 1800 after one hour, but a few points were probably lost due to HN downtime. Being quick to post is important, guys;-)

Working in Incognito mode. Not when you logged In.

Gmail and YouTube are down in India as well.

Yeah I couldn’t get the hours of operation for a store near me on Google maps. Thought it was wifi at first.

1. Phone Gmail won&#x27;t load.  2. Turn off wifi and use cell network. Still won&#x27;t load. 3. Check hacker news.

youtube works if you don&#x27;t log in. Otherwise, gmail, cloud, youtube with accounts are all down.

This is google&#x27;s way of saying do not work from home

Seems to be down in a bunch of places <a href="https:&#x2F;&#x2F;istheservicedown.co.uk&#x2F;status&#x2F;gmail" rel="nofollow">https:&#x2F;&#x2F;istheservicedown.co.uk&#x2F;status&#x2F;gmail</a>

Yep.Launched YouTube app on the Roku and was prompted to sign in. Opened browser on PC, entered &quot;activation code&quot; from YouTube app, after entering my Google account username on the login page, it presented me with the reassuring &quot;Couldn&#x27;t find your Google Account&quot; message.Tried logging in to Gmail directly with the same effect.Thanks to the Twitters, I realized that Google hadn&#x27;t canceled me, specifically (apparently they decided to temporarily cancel everyone!).FWIW, I typically get directed to their Chicago datacenter(s).(Note: 7 A.M. on the U.S. east coast on a Monday morning; at least they have impeccable timing!)

Yup, Ops Genie is BLOWING UP with alerts... but can I get into GCP to see what&#x27;s going on? Nope.

It&#x27;s a mixed bag. Cloud storage is down but at least cloud logging is up to stream all the errors.

GCP console is not working too <a href="https:&#x2F;&#x2F;console.cloud.google.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;console.cloud.google.com&#x2F;</a>, however at least the services are still running :) phew

UK here, YouTube and Gmail are innacesible, search is working fine. Workspace Status Dashboard is showing all green.

My Gmail app on iOS keeps displaying a “No Connection” error even though my phone is connected to the Internet

YouTube is working in India.
But can not log in to any Google Accounts.
GMAIL and Drive not accessible via web. 
Drive sync is working though.
Appstatus still showing green.

Transitioned to Google Workspace from Microsoft Office 365 last week and it’s a nice welcome.

Confirmed: all mentioned above down midwest!

 Google Cloud is also down. Can not access either Cloud Console or any of our GKE clusters. Stackdriver, Cloud Auth also down.

Can confirm Incognito Mode and Private Tabs are still working on YT. Seems to be something auth based.

I think it&#x27;s just Accounts is down, so anything where you are logged in isn&#x27;t working.

Seems like some core service crashed since all of these sites are unavailable. However, google.com seems to be fine.

Youtube down in India, Docs Down, Mail working

HN is the fastest way to know about outages.Youtube &amp; Gmail are down for me.

Youtube, docs down in India, Mail working

They made you interview again even after having worked there before? That&#x27;s odd. It used to be that they didn&#x27;t do that.

I interviewed for Google many years ago and recently. The expectations fell through the floor.I&#x27;ve see plots of number of employees too. I&#x27;m not sure how Google will dig itself out of that one.

I feel like Google is having more outages recently. I worked there for 4 years and even in such a short time you really noticed the shift from engineering focus to business focus. But maybe it is just a coincidence.

youtube greece is down returns &quot;oops&quot; error but i can still playback a 2 hour video that I was already watching before it went down. Trying to open any other video or channel returns this error.

In my house, it leads to a hilarious echo of multiple devices responding simultaneously with an error message. Having only one device respond seems to be cloud-mediated too.

&quot;Hey Google!&quot;&quot;Something went wrong. Try again in a few seconds.&quot;

Google Home and Chromecast also rendered useless. _Hey 
Google, how are you?_ leads to some very passive aggressive replies.

Total world economic output is ~$150M &#x2F; minute, so billions every minute is off by few orders of magnitude.

I was unable to watch the Mogwai - Autorock music video. :-(

Besides the exaggerated figure, I always find these claims bizarre. Sure, there was some momentary loss, but aggregated over a month this will not even register.

I never understood this type of calculation as it implies that time is directly converted into money. However, I struggle to come up with an example for this. Even the most trivial labor cases like producing paperclips don&#x27;t seem to be directly converting time into profit: even you will make 10k units instead of 100k this hour, you don&#x27;t sell them immediately. They bring revenue to the firm via a long chain of convoluted contracts (both legal and &quot;transactional&quot;) which are very loosely coupled to the immediate output.Nothing is operating at minute margins unless it&#x27;s explicitly priced on a minutely basis, like a cloud service. Even if a worked on a conveyor belt can&#x27;t produce paperclips without looking at Google Docs sheet all the time, this will be absorbed by the buffers down the line. And only if the worker will fail to meet her monthly target due to this, loss of revenue might occur. But in this case the service has to be down for weeks.In case of more complex conversions of time into money, like in the most of intellectual work, this is even less obvious that short downtimes will cause any measurable harm.

Nope, especially considering the implications of this, with the amount of people working remotely. Google Meet, Classroom, etc. are down. This is probably literally costing billions every minute just in loss of productivity.

Makes sense, at work we have an application running on Google Cloud and everything seems to be working. So the outage is probably not at network or infrastructure level.

If this does not improve soon, we&#x27;re looking at one of the most significant outages in recent internet history, at least from the number of people impacted.

Same.At AWS, I once took an entire AZ down of a public-facing production service (with a mis-typed command), but that was nothing compared to when I accidentally deleted an entire region via internal console (too many browser tabs). Thank goodness turned out to be unused &#x2F; unlaunched, non-production stack. I felt horrible for hours despite zero impact (in both the cases).

Well, it&#x27;s something that can happen to anyone, take it easy. When I made the transition from developer to manager and become responsible for this situations, at first every problem made me feel as you describe. Eventually what helped me to be free is the understanding that how we feel about a fact does not change anything about that fact.

I remember how one of our engineers had his docker daemon connected to production instead of his local one and casually did a docker rm -f $(docker ps -aq) .Same thing happened to me but with CI, which felt bad enough already.

Don&#x27;t be too hard on yourself, no dev works in a silo, there is usually user acceptance testing and product owner sign offs involved so they also have to wear some of this too.

If you alone were able to do it, then the system was designed badly. The bigger the impact, the more robust it has to be to prevent accidents.

When I was interviewing at Morgan Stanley, I asked &quot;how do you do this job if a mistake can cost people money?&quot;.The answer was &quot;well, if you don&#x27;t do anything, you make NO money&quot;.

Several years back when I was working at Google I made a mistake that caused some of the special results in the knowledge cards to become unclickable for a small subset of queries for about an hour. As part of the postmortem I had to calculate how many people likely tried to interact with it while it was broken. It was a lot and really made me realize the magnitude of an otherwise seemingly small production failure. My boss didn&#x27;t give me a hard time, just pointed me toward documentation about how to write the report. And crunching the numbers is what really made me feel the weight of it. It was a good process.I feel for the engineer who has to calculate the cost of this bug.

&gt; I do not envy Google engineers right now.A few years ago I released a bug in production that prevented users from logging into our desktop app. It affected about ~1k users before we found out and rolled back the release.I still remember a very cold feeling in my belly, barely could sleep that night. It is difficult to imagine what the people responsible for this are feeling right now.

Coincidentally, Google Authenticator was finally just updated on iOS after many years without update.

I am not sure why are they allowing it. Meaning why aren’t services completely isolated? Isn’t it obvious that in an intertwined environment those things are bound to happen (as in “question of when, not if”)? I understand, in smaller companies that are limited in resources (access to good developers and pressure to get product to market as soon as possible) we have single points of failure all over the place. But “the smartest developers on the planet”? What is it if not short-sighted disregard for risk management theories and practices? I mean, Calendar and Youtube, say, should be completely separate services hosted in different places, their teams should not even talk to each other. Yes, they can use same software components, frameworks and technologies. Standardization is very welcome. But decentralization should be an imperative.Edit: again downvotes started! Thanks to everyone “supporting freedom of expression” :)

Went to reply, then saw the username. My guess was lb layer

In a previous lifetime I removed an &quot;unused&quot; TLS certificate. It turns out that it was a production cert that was being used to secure a whole state&#x27;s worth of computers.In my defence, the cert was not labeled properly, nor was it used properly, and there was no documentation. It took us 2 days to create a new cert and apply it to our software and deliver it to the customer. Those were 2 days I&#x27;ll never get back. However, when I was finished the process was documented and the cert was labeled, so I guess its a win.

Several others have shared their &#x27;I broke things&#x27; experiences, and so I feel compelled to weigh in.Many years ago, I was directly responsible for causing a substantial percentage of all credit&#x2F;debit&#x2F;EBT authorizations from every WalMart store world-wide to time out, and this went on for several days straight.On the ground, this kind of timeout was basically a long delay at the register. Back then, most authorizations would take four or five seconds. The timeout would add more than 15 seconds to that.In other words, I gave many tens of millions of people a pretty bad checkout experience.This stat (authorization time) was and remains something WalMart focuses quite heavily on, in real time and historically, so it was known right away that something was wrong. Yet it took us (Network Engineering) days to figure it out. The root cause summary: I had written a program to scan (parallelized) all of the store networks for network devices. Some of the addresses scanned were broadcast and network addresses, which caused a massive amplification of return traffic which flooded the satellite networks. Info about why it took so long to discover is below.Back in the 1990s, when this happened, all of the stores were connected to the home office via two way Hughes satellite links. This was a relatively bandwidth limited resource that was managed very carefully for obvious reasons.I had just started and co-created the Network Management team with one other engineer. Basically prior to my arrival, there had been little systematic management of the network and network devices.I realized that there was nothing like a robust inventory of either the networks or the routers and hubs (not switches!) that made up those networks.We did have some notion of store numbers and what network ranges were assigned to them, but that was inaccurate in many cases.Given that there were tens of thousands of networks ranges in question, I wrote a program creatively called &#x27;psychoping&#x27; that would ICMP scan all of those network ranges with adjustable parallelism.I ran it against the test store networks, talked it over with the senior engineers, and was cleared for takeoff.Thing is, I didn&#x27;t start it right away; some other things came up that I had to deal with. I ended up started it over a week after review.Why didn&#x27;t this get caught right away? Well, when timeouts started to skyrocket across the network, many engineers started working on the problem. None of the normal, typical problems were applicable. More troubling, none of the existing monitoring programs looked for ICMP at all, which is what I was using exclusively.So of course they immediately plugged a sniffer into the network and did data captures to see what was actually going on. And nothing unusual showed up, except a lot of drops.We&#x27;re talking &gt; 20 years ago, so know that &quot;sniffing&quot; wasn&#x27;t the trivial thing it is now. Network Engineering had a few extremely expensive Data General hardware sniffers.And to these expensive sniffers, the traffic I was generating was invisible.Two things: the program I wrote to generate the traffic had a small bug and was generating very slightly invalid packets. I don&#x27;t remember the details, but it had something to do with the IP header.These packets were correct enough to route through all of the relevant networks, but incorrect enough for the Data General sniffer to not see them.So...there was a lot of &#x27;intense&#x27; discussions between Network Engineering and all of the relevant vendors. (Hughes, ACC for the routers, Synoptics and ODS for the hubs)In the end, a different kind of sniffer was brought in, which was able to see the packets I was generating. I had helpfully put my userid and desk phone number in the packet data, just in case someone needed to track raw packets back to me.Though the impact was great, and it scared me to death, there were absolutely no negative consequences. WalMart Information Systems was, in the late 1990s, a very healthy organization.

I&#x27;ve been in that situation before at one of my previous jobs, where some important IT infrastructure when down for the whole company. Nowhere as big of a scale as this, but it was easily one of the most stressful moments of my life

Given the blast radius of this (all regions appear to be impacted) along with the fact that services that don&#x27;t rely on auth are working as normal, it must be a global authN&#x2F;Z issue. I do not envy Google engineers right now.

Only thing working for me is the Google search engine

Can I just say I&#x27;m remarkably relieved I have an excuse to kick back for the next hour and do nothing?

Google play web also down along with others.

Can confirm, gmail, gdrive and youtube are down.

same just lost access to all services including Firebase here in Toronto Canada

I wonder if this means Google Fi is affected too?And I also wonder how many Google engineers might not even be getting paged right now as a result.

Also Google Voice. I ctrl+F&#x27;d for that one, and it&#x27;s one thing I haven&#x27;t found a way to easily degooglefy from. Also down.

various services are broken- youtube returning error- gmail returning 502- docs returning 500- drive not workingstatus page now reflecting outage: <a href="https:&#x2F;&#x2F;www.google.com&#x2F;appsstatus" rel="nofollow">https:&#x2F;&#x2F;www.google.com&#x2F;appsstatus</a>--------------services look to be restored.

Google outage – resolved