123
-=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- (c) WidthPadding Industries 1987 0|729|0 -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=- -=+=-
Socoder -> Site & Server -> Time to Move?

Page : 1 Prev 2
Next
Tue, 16 Jan 2018, 09:04
HoboBen
This used to be an issue with the Linux ext3 file system - after 1000 files in a directory it got pretty slow.

Sounds like they're using a modern file system like ext4 so the only limit is 32,000 files if you want to list them easily. And even then there's workarounds.

ext3 file lookup was O(n), ext4 its O(log n)

-=-=-
blog | work | code | more code
Tue, 16 Jan 2018, 12:54
Jayenkai
Kloudhost hosty hosting has been purchased and test script/php/css/sql/etc have been uploaded.

Blitzcoder.net is the test area.

Please be aware that..
A) You might get SSL Security Warnings if you try to access the site. This is being worked on!
B) The SQL on BlitzCoder.net is from a few days ago, and will be updated when the site's ready to go, properly.
C) Anything posted to BlitzCoder.net until refresh will be lost when the proper SQL is transferred.
D) I've had to retweak the Timestamp ("How long the page took to render") recorder, because the site is running at about 1/5th the speed it is, here, and the script wasn't bothering to record the timestamp, because the timestamp was too small and insignificant to bother recording a timestamp..

-=-=-
''Load, Next List!''
Tue, 16 Jan 2018, 16:41
Jayenkai
All seems nice and working'ish, over on the new server, so I think I'm going to switch it on, some time tomorrow.. Maybe about 10 or 11am, assuming I actually wake up by then

Due to the way SSL certificates work (and/or don't!!) the site might be inaccessible for a few hours.
If it is, head to Blitzcoder.net, where you can at the very least access the important bits. (Once the site becomes inaccessible, I'd have already moved everything important, SQL-wise, over to the new server, so it should be usable.)

With any luck, things should continue to flow well, but as-always, I'll be watching the error logs and other stats carefully.



-=-=-
''Load, Next List!''
Tue, 16 Jan 2018, 21:03
Jayenkai
If you can see this..
.. Welcome to the new server!

-=-=-
''Load, Next List!''
Tue, 16 Jan 2018, 21:39
Jayenkai
Word of warning : We might've lost a few uploads along the way. Zen were indeed right when they said the FTP couldn't handle more than 2000 files in a folder. The files existed, but if you opened the folder via FTP, the file-list didn't include anything beyond the 2000th file.
Quite an odd quirk, there..
The new server doesn't appear to have that issue, though.

-=-=-
''Load, Next List!''
Wed, 17 Jan 2018, 02:09
rockford
What has been seen can't be unseen. Seems fine here Jay

Hopefully everything will be relatively painless now.
Wed, 17 Jan 2018, 06:05
cyangames
Yeah, I'm pretty bad with the whole number of files per folder rule on the refresh site, but only for storing product images (maximum ftp display of 10,000), so it seems to get away with that at least.

Here's hoping the server move isn't too much of a burden Jay

-=-=-
Web / Game Dev, occasionally finishes off coding games also!
Wed, 17 Jan 2018, 06:12
Jayenkai
"wasn't"
This IS the new server. All files, sqls and scripts transferred without too much of a hitch, although it's now PHP7, so I need to rewrite bits of my online scoreboard admin page, (which oddly still uses MySQL, even though the actual score functions use MySQLi !) but other than that, it's been nice and smooth.

An alarming number of "unused variable : n" in the error logs, though.
Geeze, I really need to get a grip on those temporary n's!! Happens a lot in my gamedev code, too.

Glad I switched from Wordpress, over at AGameAWeek, mind. Having to do all that, AGAIN, would've been a bloody nightmare!



-=-=-
''Load, Next List!''
Wed, 17 Jan 2018, 06:35
cyangames
That's awesome!
Wed, 17 Jan 2018, 06:58
HoboBen
It does seem noticeably faster too!
Wed, 17 Jan 2018, 07:25
Jayenkai
Yeah, but give it time!!! We'll throttle it back to where it should be

-=-=-
''Load, Next List!''
Wed, 17 Jan 2018, 07:36
GfK
Yeah pages are loading much faster today, almost instant. Never really sure when it's my internet acting the bastard though...
Wed, 17 Jan 2018, 07:40
Jayenkai
LOL, same!
But you can see the pageload, bottom right.
It's now averaging about 0.02, whereas the Zen server was typicallly 0.15, and the GoDaddy was about 1.5!!

-=-=-
''Load, Next List!''
Wed, 17 Jan 2018, 11:03
Jayenkai
Compare!


New server


Old server

Note the vertical scale.
Mmmm.. nice!!

-=-=-
''Load, Next List!''
Wed, 17 Jan 2018, 14:57
Jayenkai
Site sizes, for those interested.

SoCoder.net - 4.19Gb (alt Socoder.com, Blitzcoder.net)
Biggest folder - "Uploads" - 3.5Gb
SQL total - 46.3Mb

AGameAWeek.com - 11.3Gb (alt Jayenkai.com)
Biggest folder - "NewJayTracks" (ALChoons) - 5.43Gb
SQL total - 5.87Mb

LittleLever.info - 115kb
Biggest file - The logo/banner at 3000x512 pixels! - 60.9Kb
SQL total - 0Mb It's just a flat .html file with nothing special.

-=-=-
''Load, Next List!''
Thu, 18 Jan 2018, 09:11
Jayenkai
*sigh*
New server has a virus scanner, which insta-quarantines evil looking files.
Unfortunately, it seems to have decided that everything coded in Blitz3D around about 2009 is infected with a "Win.Trojan.Vbiframe-85" virus.

Which it isn't.
But there's no telling it that.
Instead, I'm currently sitting here clicking on a list of 151 Quarantined files, one by one (because Bulk Actions only does delete!)...
Click file, click "Is not infected", click "Yes I'm sure", over and over and over again!!

-=-=-
''Load, Next List!''
Thu, 18 Jan 2018, 09:47
rskgames
Just noticed AGAW scoreboard page having cors issue.
Cross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at https://agameaweek.com/Scores.php?Output=List&time=1516293546995. (Reason: CORS header ‘Access-Control-Allow-Origin’ missing).
Thu, 18 Jan 2018, 09:51
rskgames
Showcases pages not displaying images due to below error.
Loading mixed (insecure) display content “” on a secure page
Thu, 18 Jan 2018, 10:10
Jayenkai
Oh, you're kidding.. Browsers are blocking "unsafe" images, now?! FFS..
That's nothing to do with the server. That's just browsers getting fucking tetchy.

Honestly, I could go through all the urls in the database making them https://, but then that would only work for images that are on the socoder server.
Any images that people have posted from elsewhere, eg A LOT OF IMAGES, will all do exactly the same thing.

I can't imagine how you're supposed to handle that.

Any thoughts?


..
As for the scoreboard, be sure you're visiting agameaweek.com/Scoreboards.html .. There *shouldn't* be any cross-domain issues with that.

-=-=-
''Load, Next List!''
Thu, 18 Jan 2018, 10:29
rskgames
Scoreboards is good. I had used "https://agameaweek.com/Scoreboards.html" which caused the issue. My Bad.

firefox 57 chrome 63.0.3239.132 and IE edge all show the same behavior with respect to the images not loading from insecure connection. It is indeed very frustrating the way browsers are behaving on every update.

Will this work https://stackoverflow.com/questions/16200501/http-to-https-apache-redirection
Thu, 18 Jan 2018, 10:34
Jayenkai
Tonight, when the server's quiet, I'm going to download the entire site database, do a find+replace https:// to https://, and then reupload it all.
Hopefully that'll fix any issues.
I *think* that if you request a https:// on a none-https-secure server, it *should* still return the https image...? Am I right!? Not sure.

-=-=-
''Load, Next List!''
Fri, 19 Jan 2018, 04:33
cyangames
the cors issue can be partially fixed in PHP, I've had similar dealing with this for a while ,check out variations of this header

header('X-Frame-Options: SAMEORIGIN');

should help out a bit, but replace SAMEORIGIN with errr something else?

Aslo, requesting https images on a non https server will likely result in failed or blocked requests. the other way around, you are more likely to be okay, depends on how the server is set-up mind.

-=-=-
Web / Game Dev, occasionally finishes off coding games also!
Page : 1 Prev 2
Next