*frontpage

Printing this post atop the VideoSift homepage - frontpage requested by a truly awesome bot.

Thanks for the heads up

Why no?

I can just shut it down even though I'm not ready if you'd like.



Still working on setting things up. As soon as I'm ready we'll be offline. Might be a little while still.

See you on the other side.

Good luck.

That was painless.

My imagination or is everything loading faster?

Comment hidden because you are ignoring dag. (show it anyway)

I hope so. That's good feedback. Feels a bit snappier to me too.

Definitely not your imagination. It is much, much faster on the site.

And the server load is ridiculously low (even for it being middle of the night in the US).

Hey fellas ... noticeably less drummin' of my fingers and heavy sighs waiting for a page to load here too ... YAY!

The video I posted post-move doesn't have a thumbnail, and won't let me add one... seems that part is broken at present, although posts with thumbnails have kept theirs.

Yay.

The missing thumbnail issue is fixed. Had to update our origin IP at our CDN. (CC @eric3579)

Side note: Yes, our new servers are absolutely, unequivocally, undeniably blazing fast now.

We've never had server load as low as it is right now. This is a phenomenal thing.

Happy days are here again.

And @lucky760 looked at the server load and he saw that it was good.

and we shall have 100% uptime now and forever, amen

Now at our peak time of day load is still averaging well under 1 on both servers, which is just unheard of on our servers.

Before today our normal average load was 2-3 on both servers.

I'm pleasantly blown away.

Why is finalizing my new video submission still slow?

It still has to be verified and validated by two Oompa Loompas wearing a capybara costume. They could be replaced by a single minion, but then we'd have to hide the bananas.

Did VS just get slow about a minute ago? I couldn't load and upvote for like a minute.

Hmm, I noticed posting comments still have pauses.

It's rather slow right now, pings result in a time-out.

Yeah, everything is slow even voting. @dag and @lucky760, report in please.

You can never ping our servers because we disable it.

@ant - Looks like our fresh server super-speed is wearing off. We may need to look into increasing the power of our DB server.

cc: @dag

Actually, it looks like the cause right now is that Bing and some other spiders are crawling us really hard again, so I have to blacklist even more IPs to fight them off.

Okay, now that I've blacklisted a few hundred IPs, our load is way back down again.

We were just getting hit from every angle by crawlers, but we should be okay now.

Something is still broken. Right now I see the list of 'Current Users' (on The Sift Talk Forum Page) has 90 people. Unless you have promised cash prizes to everyone who logs in today and stays logged in, I think there is a problem

Somehow, someway the time got screwed up on lots of records, so there are a lot of recent comments and posts and users whose dates have not yet occurred, which is making a few things look really odd.

The servers seem to have their times correct right now and all new records showing up also seem to have the right time. Since I don't know what happened or what the true times should be for all the future dates, I'm just leaving everything as-is.

Wouldn't it be better to check your robots.txt rather than blacklist the crawlers? I get 502 Bad Gateway for http://videosift.com/robots.txt

It's not 502, so I'm guessing you were hitting the server at a bad moment.

Still, crawlers don't always respect what's in the robots file.

Archive.org was crawling today, so there'll be an update before too long I'm sure.

Wow, look at VideoSift from March 2006: https://web.archive.org/web/20060315170025/http://www.videosift.com/

Lucky760, I hope you're not blocking all spiders since you do want search engines to find VS!

We let Google index us.

And not others like Y!, Bing, etc.?

@lucky760: Voting and commenting are still slow (delays) the last few days. Is VS still being hammered?

I've found a different configuration issue that I'm pretty certain is what was causing the slow Ajax requests (like voting and commenting).

Those types of things should be sped up a bit now with any luck.

Thanks!

Yay!!

Is it me or are there still some pauses like when voting and rating? I) noticed this at work and home.