It’s been over a week since my last GTN Alert or GTN QuickView and I feel like an update is warranted. I didn’t plan ahead for the rapid expansion in the size and scope of my database, which was simply being saved in Excel. The short version of the story is that the database outgrew that Excel file, but I was slow to move it into Access and the file locked up more or less. No data was lost and I’ve still collected new data every day in the past week, but I’m still finishing up the process of moving all of the data into an Access database and building queries to replace the summary tables and graphs that were in the Excel file.
The moral of the story is that over 60,000 rows of data, plus a few pivot tables and such, was a terrible idea! I’m beginning to see the light at the end of the tunnel and hopefully I’ll be able to resume the GTN QuickView posts in the next few days. In the meantime, hopefully you had a chance to read my quick post over the weekend regarding pricing efficiency, or lack thereof, in a segment of the decorations market. I’m looking forward to putting this data work behind me again to focus on more content like that post.
My next big project is already well underway, which is to expand my Unit Cost Reference to include all gathering and mission materials used in crafting. Once that baseline is in place, the project moves into the crafted items stage of building out a unit cost structure for all items in the game. I will either be creating a more user-friendly item database for the website or partnering with another website to add my unit cost information to their item database utility, but more on that later once it’s determined.
As always, thank you for reading and I appreciate the interest in the blog. Eventually these systems will be polished, finished products and there won’t be a week of downtime to fix a core back-end database hopefully, but the very sudden success of the blog means that none of these things were built to scale and I’m making it up on the fly, but it’s a ton of fun and all of your emails and tweets keep me very motivated to keep working through the rough patches.
– Andrew | SWTOR Economics