Recent downtime

6

We've had a substantial amount of downtime at peak hours yesterday and today. I think the problem is related to vote counts on blogs, so I'm testing a fix now and will hopefully have it up on the main site within the hour. Thanks for your patience, everyone!

Edit: Aaaaand we're back. Some blog posts that had likes may appear to have...
Read More

VIEW 3 of 3 COMMENTS
myzaree:

Thank you 

suispud1:

Okay. 

Favourites and bookmarks have been brought in from the old site

7

We've brought over all of the favourites and bookmarks from the old site and turned them into follows. Here are some details:

- All favourites or bookmarks to users who have set their account to "you approve all followers" in preferences were ignored. They were not turned into follow requests.

- Any favourites or bookmarks that would have violated blocks were also ignored.

- Users who have...
Read More

VIEW 8 of 8 COMMENTS
andrewfoundry:

@urobolos The tables we migrated the data from seemed to be straightforward, but there's always the possibility that we made a mistake.  If you want to help track down any issues, please message me with a few specific examples of people you should be following that aren't, and people you are following that you shouldn't be.

puffin:

Thanks for the updates! xxxx

Unplanned downtime!

5

We had a string of performance issues, punctuated by about thirty minutes of outright downtime, tonight. We think it was caused by a one-off maintenance process that was taking up too much of the master database's resources. Of course, that shouldn't bring the site down, but a few other issues we have with our web processes timing out and leaving their TCP connections...
Read More

jephn:

I was trying to log on. I thought the internet was telling me to go read a book.

Photoset image resolution is improving!

5

A number of members reported in Everything SG that recent SG photosets seemed to be blurry on the new site. We diagnosed the issue, and a background process is now going back and fixing all of the affected SG and hopeful albums to upgrade their image quality (by going back and copying different files from the old site than we originally grabbed). The newest SG...
Read More

"Application error" bug hunting

3

I took the site down for a few minutes for a code push. We're trying to fix the "application error" issue, where randomly some requests will take a long time to load and then time out. Previously those timeout errors would clump together and we'd get a period of 20-30 minutes with a 5-10% error rate (this might happen a few times during...
Read More

VIEW 9 of 9 COMMENTS
trevor:

lulz

andrewfoundry:

Okay, a fix for that problem (pressing enter to select a user submits your comment) is live and this is a test.  @jimfoundry

Groups are no longer visible to non-members

5

Among other changes pushed today, we've stopped showing group pages to non-members as per Sean's instructions. This applies to the groups that were previously "boards" as well. The status of former boards may be changed in the future, or we may let groups choose whether they would like to be fully public or members-only in the future, but for now all groups are...
Read More

cockzombie:

Great. Please don't change this without emailing all members, including former members. :) 

Photo upload problem

1

It looks like people have been having trouble with photo uploads since the last patch. I'll take the site down for a brief minute to roll back the change.

VIEW 3 of 3 COMMENTS
catdad:

I saw your post when it said 0 Mins Ago.   Within about 10 minutes, the site was up again.  Impressed.

chrisjlazer:

@catdad it took about 45 minutes to resolve, but overall pretty quick firedrill.

Error rate

0

We are experiencing a very high (~8%) error rate on requests, but a perfectly normal response time for non-error requests. I may have to take the site down briefly to diagnose the issue.

catdad:

Don't envy your current workload, but I'm impressed with how smooth the mechanics of this transition have gone, as well as the frequent updates and responses to issues.  Most of them seem to be front-end, cosmetic, or just longings for the old ways.  Hope people give this a few (or several) weeks to settle down before passing judgement.

andrewfoundry:

@catdad Thank you!  I appreciate the kind words.  The new site is a total rewrite, as far as I'm aware it's the first 100% frontend and backend rewrite in the site's history, so a lot of features were left behind for 1.0.  But since we had a relatively smooth launch (as far as these things go) there's good hope that we'll be able to address a lot of requests for tweaks, old features and new features over the next few months.

Changelog Oct 7

0

- Improved cropping process for profile photos

- Display number of likes instead of % for SG and Hopeful albums (edit: right now you can only see number of likes and not %; soon you will be able to see both depending on where you are, e.g. you will be able to see %s if you are on the photos page and sorting by like %)

- Show high resolution...
Read More

That one was on purpose

3

I brought the site down for about five minutes to switch to a larger database. Suicidegirls is now running on Heroku's "giant robot" database plan, with 68 GB of RAM. No joke. https://addons.heroku.com/heroku-postgresql

VIEW 3 of 3 COMMENTS
andrewfoundry:

Actually, I'm setting up the Kaiju ("Baku" plan) as a follower database so we can run indexing, etc. on it.  So the giant robot and the kaiju are teaming up!

trevor:

You have no idea how hard my inner nerd is smiling at that. @sid