A malfunction that shut down all of Toyota Motor's assembly plants in Japan for about a day last week occurred because some servers used to process parts orders became unavailable after maintenance procedures, the company said.
I’m sending this to my boss to remind him why monitoring disk space is vital.
$100 says there is a series of emails sent by a sysadmin/DBA over the past couple months warning about this issue in explicit detail and its increasing urgency, that have been ignored.
The person sending the emails will still get chewed out because they failed to make the higher ups realise this is a real problem.
I used to be a sysadmin, now a software developer. At one of my old jobs for a massive corporation, they decided to consolidate several apps’ db servers onto one host. We found out about this after it had already happened because they at least properly setup cname records so it was seamless to us. Some data was lost though, but having literally billions of records in our db, we didn’t notice until it triggered a scream test for our users. We were also running up against data storage limits
They ended up undoing the change which caused us a data merge nightmare that lasted several full workdays.
The only thing worse than a single database server is servers poorly maintained database servers. The idea was right, but maybe the implementation was wrong.
$100 says there is a series of emails sent by a sysadmin/DBA over the past couple months warning about this issue in explicit detail and its increasing urgency, that have been ignored.
The person sending the emails will still get chewed out because they failed to make the higher ups realise this is a real problem.
I used to be a sysadmin, now a software developer. At one of my old jobs for a massive corporation, they decided to consolidate several apps’ db servers onto one host. We found out about this after it had already happened because they at least properly setup cname records so it was seamless to us. Some data was lost though, but having literally billions of records in our db, we didn’t notice until it triggered a scream test for our users. We were also running up against data storage limits
They ended up undoing the change which caused us a data merge nightmare that lasted several full workdays.
This phrase has brought me much joy.
The only thing worse than a single database server is servers poorly maintained database servers. The idea was right, but maybe the implementation was wrong.
my $100 goes to them storing so much of their customers’ personal data on the servers
While that story is shitty I doubt the manufacturing control DB and customer data DB are anywhere near each other.
Of course, to get anything done by corporate japan you need to put it in writing and fax it.