Exporting lighthouse data

Pieter Claerhout's Avatar

Pieter Claerhout

26 Oct, 2009 02:51 PM

Hi all,

I created a tool which uses the LightHouse API to create an offline copy of an account. It works fine but it's terribly slow as it needs to download each ticket individually to get the history of a ticket.

Is there any way to easily get all the data from a LightHouse account in e.g. one huge XML file which then can be parsed and used?

The reason we are doing this is because we want to put all the data in an offline database so that we can easily create custom reports using tools such as Crystal Reports and FileMaker Pro.



  1. 1 Posted by Will Duncan on 27 Oct, 2009 03:20 AM

    Will Duncan's Avatar

    We have some ideas for some full export dump options due up on the roadmap shortly, but right now the standard API is your best option. Rick may have a suggestion for a faster resource though, I'll tap him on the shoulder tomorrow and see if he has an idea.

  2. 2 Posted by Carolyn on 28 Oct, 2009 02:11 AM

    Carolyn's Avatar

    We actually are wanting to do the same thing - export tickets from lighthouse so we can keep a copy offline as back up and to run reports on. So we too would like to know how and when we can do this.

    Thanks Kaz

  3. 3 Posted by System on 13 Nov, 2009 06:26 PM

    System's Avatar

    This discussion was assigned to Courtenay Gasking, on ticket 12.

  4. 4 Posted by Rick on 13 Nov, 2009 06:29 PM

    Rick's Avatar

    Thanks for the suggestions. This is on the roadmap. We currently do have an export format, it's just a matter of adding a form for users to request them by email. The current hangup is the fact that they can be fairly intensive to build on the server for larger projects.

    If you'd like, I can send you guys a dump of your accounts so you can at least get started running reports.

  5. 5 Posted by Pieter Claerhou... on 17 Nov, 2009 02:17 PM

    Pieter Claerhout's Avatar

    I would love to get such a dump. What information do you need from us in order to create such an export?



  6. 6 Posted by Rick on 25 Nov, 2009 05:58 AM

    Rick's Avatar

    Pieter: All I need is the account name of an account you're a member of. I see you have a lot of projects under an account though, so I can just export only those projects that you use. Do you want a dump for all of it?

  7. 7 Posted by Pieter Claerhou... on 25 Nov, 2009 09:20 AM

    Pieter Claerhout's Avatar

    Hi Rick,

    my account is shpartners.lighthouseapp.com. It would be great if you could create an export of all projects of this account.


  8. 8 Posted by Rick on 25 Nov, 2009 10:21 PM

    Rick's Avatar

    I'm sending you a 100MB backup of all the data for the 35 projects in that account that you have access to. It's sending right now through Dropsend to your email address. Let me know if you have any problems.

  9. Rick closed this discussion on 25 Nov, 2009 10:21 PM.

  10. Pieter Claerhout re-opened this discussion on 26 Nov, 2009 08:49 AM

  11. 9 Posted by Pieter Claerhou... on 26 Nov, 2009 08:49 AM

    Pieter Claerhout's Avatar

    Hi Rick,

    the export looks great, except for two things.

    Would it be possible to get an export with the file attachments? For the reporting we will be doing, we don't need the files and it would make the export file a lot more manageable...

    I'm also missing the ticket history. In the ticket.json files, I can only find the original and latest bodies, but none of the other versions.



  12. 10 Posted by Rick on 26 Nov, 2009 09:35 PM

    Rick's Avatar

    Hmm, I definitely saw some attachments in there. You should be
    getting the full data for everything. Maybe there's a bug in the
    exporter then. I'll have a look.

  13. 11 Posted by Pieter Claerhou... on 27 Nov, 2009 08:16 AM

    Pieter Claerhout's Avatar


    I made a small typo in my previous reply. What I want is an export without the file attachments.

    The current export does include all the file attachments, but this makes the export too big to be manageable for me.



  14. 12 Posted by Nicole on 17 Dec, 2009 08:36 PM

    Nicole's Avatar

    Hi Pieter -

    Sorry for the delay. Do you still need the export without attachments?


  15. 13 Posted by Pieter Claerhou... on 18 Dec, 2009 12:45 PM

    Pieter Claerhout's Avatar

    Yes, I still need the export without the attachments but with the ticket history.



  16. 14 Posted by Rick on 18 Dec, 2009 08:28 PM

    Rick's Avatar

    Ok, just sent you the export.

  17. Rick closed this discussion on 18 Dec, 2009 08:28 PM.

  18. Pieter Claerhout re-opened this discussion on 18 Dec, 2009 08:29 PM

  19. 15 Posted by Pieter Claerhou... on 18 Dec, 2009 08:29 PM

    Pieter Claerhout's Avatar


    ik ben op vakantie. Vanaf maandag 4 januari 2010 ben ik weer bereikbaar.

    Indien je dringende vragen of problemen hebt, gelieve contact op te nemen met SHpartners op het nummer +32 497 55 00 00.

    Met vriendelijke groeten,


    Pieter Claerhout
    Web, iPhone & FileMaker 9 & 10 Certified Developer
    [email blocked]
    [mob] +32 497 44 04 81
    [office] +32 497 55 00 00
    [fax] +32 9 270 01 82

  20. 16 Posted by Pieter Claerhou... on 04 Jan, 2010 09:25 AM

    Pieter Claerhout's Avatar

    Excellent, it looks exactly like what I need. Is there any way the user can initiate the creation of this export?

  21. 17 Posted by Justin Palmer on 04 Jan, 2010 07:43 PM

    Justin Palmer's Avatar

    That's on the roadmap, but at the moment we're doing it on a case by case basis because we need to have some other things in place before hand. It can be a pretty heavy hit on the DB.

  22. 18 Posted by nstasino on 26 Feb, 2010 10:19 PM

    nstasino's Avatar

    Hi all,

    I'm also interested in an export of full ticket history. Is there any development with this option?


  23. 19 Posted by Rick on 01 Mar, 2010 06:39 PM

    Rick's Avatar

    There is, but it's not ready. File a private issue with details about your account and I'll send you an export. Thanks!

  24. Rick closed this discussion on 01 Mar, 2010 06:39 PM.

Discussions are closed to public comments.
If you need help with Lighthouse please start a new discussion.

Keyboard shortcuts


? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac