[kscherer]

Pockets empty, parked, and out for the weekend.

Knock yourselves out.

[Brad]

I'm stopping the server now. Hopefully I don't screw this up!

[Brad]

Here we go… this might take a while!

[20:57:27] [Server thread/INFO]: Forcing world upgrade![20:57:27] [Server thread/INFO]: Counting chunks...[20:57:36] [Server thread/INFO]: Upgrading all chunks...[20:57:36] [Server thread/INFO]: 0% completed (19 / 321026 chunks)...[20:57:37] [Server thread/INFO]: 0% completed (46 / 321026 chunks)...[20:57:38] [Server thread/INFO]: 0% completed (87 / 321026 chunks)......[20:58:11] [Server thread/INFO]: 2% completed (8740 / 321026 chunks)...

[Brad]

A few file facts about the old world while I wait...

Pre-trim main world size? 4.5 GB spanning 1270 region files
Western-most region file location? -40
Eastern-most region file location? 35
Northern-most region file location? -24
Southern-most region file location? -23
(plug those numbers into something like this under "Region Informations" to see how far out they are)

Post-trim pre-conversion main world size? 168 MB spanning 33 region files.
The regions files we're keeping, their sizes, and when they were last visited are:

7.7M Nov  2 19:56 r.0.0.mca5.1M Nov  2 08:03 r.0.-1.mca5.3M Nov  1 12:30 r.0.1.mca5.2M Oct 31 09:44 r.0.-2.mca5.0M Oct 12 15:59 r.0.2.mca4.9M Oct 12 17:58 r.0.-3.mca5.1M Oct 12 15:54 r.0.3.mca5.2M Oct 12 15:54 r.0.4.mca5.2M Nov  1 12:30 r.-1.0.mca7.1M Nov  2 19:32 r.1.0.mca5.5M Oct 23 13:10 r.-1.-1.mca5.5M Nov  1 12:31 r.-1.1.mca5.6M Nov  2 19:30 r.1.-1.mca4.8M Nov  2 19:52 r.1.1.mca5.5M Oct 12 15:51 r.-1.-2.mca4.5M Aug 11 12:12 r.-1.2.mca5.8M Nov  2 19:32 r.1.2.mca5.7M Nov  2 19:29 r.2.0.mca4.7M Nov  2 19:29 r.2.-1.mca5.0M Nov  2 19:54 r.2.1.mca6.2M Nov  2 19:31 r.2.2.mca4.6M May 21 11:18 r.-2.3.mca4.2M Nov  1 13:36 r.3.0.mca4.2M Oct 23 11:14 r.3.-1.mca4.5M Nov  1 13:36 r.3.1.mca4.6M Jul 31 16:04 r.3.-3.mca4.6M Oct 31 11:06 r.-4.0.mca4.8M Jul 31 16:47 r.4.-3.mca4.1M Jul 31 16:04 r.4.-4.mca4.4M Oct 31 11:05 r.-5.0.mca4.7M Oct 31 11:05 r.-5.1.mca4.5M Sep 10 20:24 r.-6.0.mca5.8M May  9 08:16 r.-6.-1.mca

[709]

That's likely 90% all on me... Not exploring so much as following Nether Pearls and coasting around with Elytra.

I'll reign it in so we won't have to trim for 1.14.

[709]

Ack! Not whitelisted.

[Brad]

Still poking around…

[Brad]

Okay, good news first! It seems that the world data itself has converted mostly correctly! I've restored the whitelist so 709 can start thrashing things again.

Then the less good news!

Along with rest of the dat files, all of the maps have been wiped clean.

That's gonna be fun to rebuild.

Signs have some occasional garbage text in them. Not sure what caused that, but we can fix them as we find them by just tearing them down and reposting.

Many of the "command button" contraptions around the world are broken. I'll try fixing the transporters around the Enterprise and the armor-givers around Bradtropolis (and in my attic).

I also used this opportunity to upgrade Java from 1.8 to 1.11. Maybe that'll make things a little smoother or faster? I wouldn't bet on it. If things actually get less stable and we suspect Java is the culprit, it's not hard to downgrade to 1.8.

[709]

Don't worry about the signs; the last update wiped them all out as well.

Can we reset them to 0 somehow? If not, not a big one.

[Brad]

This should make T happy, too:

[bsmith@anmc7 region]$ ls -lh /opt/minecraft/backups/*.gz-rw-rw-r-- 1 minecraft minecraft 3.4G Nov  2 02:52 /opt/minecraft/backups/world.20181102.025101.tar.gz-rw-rw-r-- 1 minecraft minecraft 3.4G Nov  2 08:52 /opt/minecraft/backups/world.20181102.085052.tar.gz-rw-rw-r-- 1 minecraft minecraft 3.4G Nov  2 14:52 /opt/minecraft/backups/world.20181102.145053.tar.gz-rw-rw-r-- 1 minecraft minecraft 432M Nov  2 20:50 /opt/minecraft/backups/world.20181102.205029.tar.gz-rw-rw-r-- 1 minecraft minecraft 473M Nov  2 21:38 /opt/minecraft/backups/world.20181102.213746.tar.gz

First three are the old world.
Second from the end is the trimmed world.
Last one is the converted trimmed world.

It seems the new world format compacts a lot better than the old! I want to run some tests to make sure the backup isn't mysteriously skipping anything and that the savings are legit, but so far it looks good.
edit: I was looking in the directory before the backup was completed earlier, and the number on the last file looked too small. All is OK now!

[709]

So is the End & Nether trimmed as well?

[Brad]

Negative… I didn't think to trim the End and Nether. I may have overlooked that conversation, but it's not too late. Did we have a particular size/region we want them trimmed to?

[709]

Out to +/- 1536 each way, which is basically a 6x6 large one grid.

[Brad]

Sounds good! Let me punch in some new numbers and updates to the reaper script, and I'll take down the world shortly (will warn before I do) to do just that.

[709]

I have fish outside my windows. I already love this update.

[Brad]

Great!

I'm stopping the server again to trim the end and nether regions...

[Brad]

And we're back again! After all this trimming, backups are tiny by comparison to just a few hours ago.

-rw-rw-r--   1 minecraft minecraft 283M Nov  2 22:11 world.20181102.221132.tar.gz

[Brad]

Ruh roh… It looks like we hit our first snag.

[23:00:23] [Server thread/WARN]: Can't keep up! Is the server overloaded? Running 3617ms or 72 ticks behind[23:00:40] [Server thread/WARN]: Can't keep up! Is the server overloaded? Running 2007ms or 40 ticks behind[23:00:57] [Server thread/ERROR]: Encountered an unexpected exceptionh: Exception ticking world entities        at net.minecraft.server.MinecraftServer.b(SourceFile:759) ~[minecraft_server.1.13.2.jar:?]        at so.b(SourceFile:360) ~[minecraft_server.1.13.2.jar:?]        at net.minecraft.server.MinecraftServer.a(SourceFile:681) ~[minecraft_server.1.13.2.jar:?]        at net.minecraft.server.MinecraftServer.run(SourceFile:584) [minecraft_server.1.13.2.jar:?]        at java.lang.Thread.run(Thread.java:834) [?:?]Caused by: java.util.ConcurrentModificationException        at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:1042) ~[?:?]        at java.util.ArrayList$Itr.next(ArrayList.java:996) ~[?:?]        at axy.o_(SourceFile:1136) ~[minecraft_server.1.13.2.jar:?]        at td.o_(SourceFile:491) ~[minecraft_server.1.13.2.jar:?]        at net.minecraft.server.MinecraftServer.b(SourceFile:755) ~[minecraft_server.1.13.2.jar:?]        ... 4 more[23:00:57] [Server thread/ERROR]: This crash report has been saved to: /opt/minecraft/versions-local/1.13.x-vanilla/./crash-reports/crash-2018-11-02_23.00.57-server.txt[23:00:57] [Server thread/INFO]: Stopping server

I'll go restart it.

[709]

So did you start a new seed or are we running the same seed just stripped of data? I went north, briefly, and it looks close to the same. Maybe it's just that.

[Brad]

Same seed as before. Would we like a new seed? Because I might be game for that. I could trim the overworld again and reload the server with a new seed, although I might need to fiddle with the root dat file to make it take effect.

[709]

No, same seed is great!

Or another. Without a map to reference it really doesn't matter. Maybe it would be fun to give the world one last random spin?

[Brad]

Dang… it crashed again. I'll try downgrading to the old Java 1.8 to see if that helps us last longer.

[Brad]

And again with 1.8 within just a minute of running.

I'm going to do a little googling before starting up again to see if we're not the only ones with this issue...

[709]

Not only that, but I'd really like to find out the glitch behind deadly armor stands. Can't seem to find anything so far.


[edit]: ahyy I need to take care of my galumpki batch – have to pick this up tomorrow.


Thanks Brad! :

[Brad]

FWIW, I've restored a world backup from right after I converted the world, and I've downgraded to Java 8. I'm going to fly around the world, poke some things here and there, and see how long this holds up…

edit: Not even 2 minutes. I guess I'll be filing a bug report to Mojang.

[Brad]

Flying around alone for a while with the server using Java 11 again, I was not able to reproduce the crash. I also couldn't find anything specifically relevant in the Mojang tracker to this issue, although there have been several cases in the past of "java.util.ConcurrentModificationException" being raised and crashing the whole game that were fixed in previous releases. As a very crutchy band-aid, I have modified our service script to restart the game server if it detects an unexpected shutdown.

For turtle, this means I tweaked /etc/systemd/system/multi-user.target.wants/minecraft.service to add:

Restart=alwaysRemainAfterExit=no

I tested these settings by forcing the game to halt using the "/stop" op command, and within a minute it was right back up again.

It's something. ¯\_(ツ)_/¯

I'll keep an eye on the "crash-reports" folder over the next couple of days, and I'll file a bug for Mojang with anything new that comes up henceforth.

[709]

Poked around a bit this morning and it looks great! Still a bit crashy, but I was able to spend enough time to find some turtle eggs and build a conduit.

Thanks again Brad!


[edit]: One thing - the Guardian Grinder is boinked. Probably need to move the Monuments.dat file over like we did in the previous upgrade. Other than that I haven't seen anything weird. Visited a nearby area that I kinda knew where a village was, and it's there with the smithy's chest is intact. So it looks like BradMagic worked for those. Nice!

[709]

With new worlds come new farms! It's the cycle of life. And death.

We have a functioning kelp farm that auto-roasts kelp into edibles, or if you prefer bind them into blocks. Also a scute farm that is very very very slow. The eggs take almost forever to hatch, and once they do the babies take nearly that to mature. Maturity can be sped up by feeding, but still takes quite a bit of time.

I might throw down some turtle eggs around the world if no one minds, just to get a few more breeding spots.

[kscherer]

Knock yourself out, Farmer John.

[Brad]

Nice!! I like turtles.

I forgot to mention when I was wandering the world over the weekend that I Johnny Appleseeded a bunch of kelp around our area. Hopefully not too much to be a nuisance but enough to fill out some of the barren ocean wasteland and to put some within grasp if anyone wants to find some "naturally".

I should'a known 709 would have assembled a fully-automated kelp factory before I could get a word in edgewise.