Print

Please login or register.
1 Hour 1 Day 1 Week 1 Month Forever
Login with username, password and session length

[timmeh]

I was looking through the Future of the Fortress topic, and was reading this and decided that, instead of bugging Toady to make DF export all the information in XML format, I'd write a simple program to convert the current files to XML format.  There are now two versions available, one as downloadable .exe files (technically .zip), and one in Javascript/HTML, which can be accessed without a download.

Neither version the program (currently) syntax checks the outputted XML.  I advise downloading XML Marker (freeware XML editor) for syntax checking.  If you have any problems with the outputted XML, please let me know, and I'll see about fixing it.

Enjoy!

Download - 547KB
Site and Population Converter
World History Converter
Site and Population Display Example
World History Display Example
Sites and Populations, DF Output
World History, DF Output

Spoiler: IMPORTANT DOWNLOAD INFORMATION (click to show/hide)

Instructions for use of the executable version are included in the .zip file, which has to be extracted for the program to work!!!

If the program hangs after printing a line, see if you can copy down the line it printed before hanging, and upload the text file somewhere, and I'll see if I can find the problem and fix it.

Spoiler: Releases (click to show/hide)

Mar. 06, 2010 - 10:59AM
Full program is made available online without a download.

Mar. 04, 2010 - 6:57PM
First half of the program has been converted to Javascript,
for simpler web-based access.

Feb. 26, 2010 - 12:48PM
I wrote two examples (in HTML and Javascript) that display
the output XML files to a web-page.  I've also made it read the
ages and spheres as one big strings, and fixed a bug causing it to add
an empty <outlived> tag to rulers who didn't outlive any of their
children.

Spoiler: Non-release Progress (click to show/hide)

Feb. 26, 2010 - 1:31AM
Next version should have example web-pages that'll use
Javascript to display the XML fies in tables.  It'll also capture
the ages and spheres as complete strings.  Not ideal, but it'll
work until I get it to work the way I want it to.

Feb. 25, 2010 - 7:08PM
I've got it formatting the output XML files with tabs now. 
After I get it reading the ages of the children and the sphere
information I'll upload a new version.  If I can't figure out
how to read the ages and spheres individually I'll just have it
capture the entire string for the time being.

[timmeh]

New release, see first post.

[Dohon]

You, sir, are a true Dwarf.

Will try this out tonight.

[timmeh]

Will try this out tonight.

Any luck? 

[timmeh]

Quick question, I've been working with Javascript a lot lately, and it shouldn't be too hard for me to make this a web-app instead, would that be worth my time?  Would anyone use it as such?

Basically, it would require that you copy-paste the text from one of the files into a text-box, and it would output the XML file into another one.  Ought to make this a lot more accessible than the console app, and really all it will require is some syntax changes, and some small changes to the way it loops through the lines of text...

[Naes Draw]

As long as it wasn't too hard to find, that sounds usable.

[timmeh]

The source would be free, in case something happens to my website, but in the mean time it would reside there, and should be pretty simple, two text areas and a button.

[EDIT]:  I got the converter for the sites and populations file done.  It can be found here.  It's overly simple and rather ugly at the moment, but it functions.  I'm having some trouble with the table output part, since I'm using JQuery now it doesn't want to play nice, so I'm going to rewrite it some time tomorrow.  Then I can write up the world history converter, and see about getting that info displayed. 

And before I forget, using this is incredibly simple.  Just copy the contents of your "regionX-world_sites_and_pops.txt" file into the top text area (after deleting the instruction text), and click the button, the text area below will be filled with the XML.  It's probably a little buggy, so I'll look over it all again tomorrow, but I'm to tired to write anymore coherent code right now...

[EDIT2]:  I got the Site display done, links to both are in the first post.

[EDIT3]:  And a random example DF output, for those who don't care to generate their own for testing purposes: Link

[timmeh]

The full program, both for site and population as well as world history, is available online without a download.  See the first post for links to the converters, example display pages (mediocre at best, but it's something) and example DF output files for anyone who doesn't want to generate a new world just to test this.

[Scarpa]

This is pretty sweet, I'll keep playing with it and let you know if I run into any issues.

[Hummingbird]

This is awesome! And thank you for making it available as a webapp; not all of us have PCs.

The World History converter doesn't seem to work, though. And the file it asks me to copy-paste is the same as in the Sites and Pops converter. Neither file showed results when inputted into the history converter.

But this is a great tool you have here. Keep it up, please!

[Kaelem Gaen]

I can't find the region text file, I assume it's what you're supposed to get when you hit the p button after the world gens? (or is it d)?

Nevermind  it was because the feature was broken on d## series, though maybe only d17+  -goes to test- Yep at least it's broken in D17, haven't tried d18 opr D19 2

[timmeh]

@Scarpa - Thanks, the input is really appreciated!  I love working on stuff like this, but I don't have a whole lot of free time to test it...

@Hummingbird -   A point a mac-fan friend of mine has made very apparent to me recently   Speaking of which, while it should be cross browser, I make no guarantees for IE... IE has this nasty tendency to require that things be done differently from every other browser, and from the W3 standards...

As far as the world history converter, that was just a typo... the name of the file that's contents should be pasted in there will be something like "region2-world_history.txt" (although the world folder will be where "region2" is).  The example file I posted seems to work, if you have any problems with it just let me know, the file you pasted, and the browser you're using would be awesome too

Thanks, will do! 

@Kaelem Gaen - The example files were exported via Mike Mayday's package, which I believe is D16.  I haven't really gotten the chance to mess around with the newer versions yet, so I can't say there...  thanks for the input though, good to know

[Hummingbird]

I pasted the world history file into the World History to XML Converter, and pressed "^To XML v"—nothing happened.

[Scarpa]

The History to XML web page is not working for me either. Same issue as Hummingbird.

I have run into two issues so far, one was a problem with a special character in a world name and the other is with malformed XML.

The first issue I have to look into more to get you more information.

The other issue is with the empty ruler lists. Specifically, if the last civilization in the world history file has an empty ruler list this is what you get in the XML output:

Code: [Select]

<rulers>
<ruler>
</rulers>

If a civilization with an empty ruler list is followed by another civilization you handle it correctly and this is produced:

Code: [Select]

<rulers>
</rulers>

I have been thinking about a Legend browser type project since I heard Toady was thinking about XML output. I want to make something completely browser driven and to start I am messing with XSL stylesheets.

Here is a stylesheet I put together this afternoon. Save the contents as history.xsl or something, and reference it from the xml file by adding the following tag:

Code: [Select]

<?xml-stylesheet type="text/xsl" href="history.xsl"?>
Then when you view the XML file in browser it will transform the data to html using the stylesheet.

Spoiler (click to show/hide)

Code: [Select]

<xsl:stylesheet version = '1.0'
     xmlns:xsl='http://www.w3.org/1999/XSL/Transform'>
<xsl:key name="races" match="civ" use="race"/>
<xsl:template match="/">
<h1><xsl:value-of select="/world/name"/></h1>
<h3><xsl:value-of select="/world/translation"/></h3>
<xsl:for-each select="//civ[count(. | key('races', race)[1]) = 1]">
<xsl:variable name="cur_race" select="race" />
<DIV><h4><xsl:value-of select="$cur_race" /></h4></DIV>
     <xsl:for-each select="//civ[race=$cur_race]">
          <DIV>
               <b>
               <xsl:value-of select="name"/>
</b>
<br/>Ruled by: <em><xsl:value-of select="rulers/ruler[last()]/name"/></em>
<xsl:if test="not(rulers/ruler[last()]/death)">
(Living)
</xsl:if>
          </DIV>
     </xsl:for-each>
<br/>
</xsl:for-each>
</xsl:template>
</xsl:stylesheet>

edit: Cleaned up stylesheet so races weren't hard coded.

[Sizik]

In the sites and populations converter, names with non-ASCII characters cause the <site>, <id>, <name>, <translation>, and <type> tags to not appear, just leaving a list of creatures.
Example:
Input text:

Code: [Select]

1: Gozru Ospsƒs, "The Hell of Neutralization", a cave
1 cyclops
1 cougar
6 ratmen
332 purring maggots
352 cave spiders
444 bats
2: Nanggo‰sru, "The Ashamed Crevices", a cave
5 trolls
395 bats
3: Ilusoggez, "The Everseeing Hole", a cave
1 alligator
5 giant cave swallows
251 bats
254 purring maggots
4: Omana, "Bursthole", a cave
1 alligator
1 giant mole
3 trolls
313 purring maggots
334 bats
5: „olpusedme, "The Impure Murk", a cave
1 grizzly bear
1 black bear
5 giant rats
364 bats
420 cave spiders
6: Tosnospos Nelo Omstu, "Weaknessabyss the Defects of Worrying", a cave
... (Note: in DF these names would be Gozru Ospsâs, Nanggoësru, and Ńolpusedme)
Output XML:

Code: [Select]

<world>
<creature>
<name>cyclops</name>
<number>1</number>
</creature>
<creature>
<name>cougar</name>
<number>1</number>
</creature>
<creature>
<name>ratmen</name>
<number>6</number>
</creature>
<creature>
<name>purring maggots</name>
<number>332</number>
</creature>
<creature>
<name>cave spiders</name>
<number>352</number>
</creature>
<creature>
<name>bats</name>
<number>444</number>
</creature>
<creature>
<name>trolls</name>
<number>5</number>
</creature>
<creature>
<name>bats</name>
<number>395</number>
</creature>
<site>
<id>3</id>
<name>Ilusoggez</name>
<translation>The Everseeing Hole</translation>
<type>a cave</type>
<creature>
<name>alligator</name>
<number>1</number>
</creature>
<creature>
<name>giant cave swallows</name>
<number>5</number>
</creature>
<creature>
<name>bats</name>
<number>251</number>
</creature>
<creature>
<name>purring maggots</name>
<number>254</number>
</creature>
</site>
<site>
<id>4</id>
<name>Omana</name>
<translation>Bursthole</translation>
<type>a cave</type>
<creature>
<name>alligator</name>
<number>1</number>
</creature>
<creature>
<name>giant mole</name>
<number>1</number>
</creature>
<creature>
<name>trolls</name>
<number>3</number>
</creature>
<creature>
<name>purring maggots</name>
<number>313</number>
</creature>
<creature>
<name>bats</name>
<number>334</number>
</creature>
<creature>
<name>grizzly bear</name>
<number>1</number>
</creature>
<creature>
<name>black bear</name>
<number>1</number>
</creature>
<creature>
<name>giant rats</name>
<number>5</number>
</creature>
<creature>
<name>bats</name>
<number>364</number>
</creature>
<creature>
<name>cave spiders</name>
<number>420</number>
</creature>
</site>
<site>
<id>6</id>
<name>Tosnospos Nelo Omstu</name>
<translation>Weaknessabyss the Defects of Worrying</translation>
<type>a cave</type>
...

See how the first two sites are only a list of animals, and the creatures from the fifth site are merged into the fourth site.

Also, it doesn't include the
   Unnumbered beetles
   Unnumbered worms
   Unnumbered ants
at the end of the file.

And I can't get the history converter to work at all.