I’m looking for some advice on a data warehouse setup that won’t give me a headache to manage. Our IT guys have thrown out a few ideas:
PostgreSQL
Oracle
SQL Server
But I’m open to other suggestions too.
Here’s the deal: we’re a small company and we use Jira for pretty much everything. We keep our business stats and operational info in there, and we even use it for making charts and reports (though they’re not as fancy as what you’d get with Qlik or Power BI).
The problem is, our data’s been growing like crazy over the last couple years. Jira’s starting to struggle with row-level security and can’t handle reports that pull from multiple sources.
We want to set up a data warehouse to bring everything together - Jira data and stuff from other places - so we can make better reports using Qlik.
Any thoughts on what might work best for us? We’re not looking for anything too complicated. Thanks!
have u considered Redshift or BigQuery? they’re pretty easy to set up and work well with jira data. plus, you only pay for what u use. might be worth checking out if you want something simple but powerful. good luck!
Have you looked into Snowflake? It’s a cloud-based data warehouse that’s quite popular these days. It’s pretty straightforward to set up and can handle data from various sources, including Jira. The nice thing about Snowflake is its scalability - you can start small and grow as needed. It also plays well with Qlik for reporting.
One advantage is that Snowflake separates storage and compute, so you’re not paying for processing power you’re not using. This can be cost-effective for smaller businesses. It also has good security features, which might help with your row-level security concerns.
Just a thought to add to your list of options. Whatever you choose, make sure it can grow with your business and doesn’t require a ton of maintenance. Good luck with your search!
I’ve been in a similar situation with my small business, and we ended up going with PostgreSQL. It’s been a solid choice for us, especially when dealing with Jira data.
The setup wasn’t too complicated, and it’s been handling our growing data needs without breaking a sweat. We use pgAdmin for management, which makes things pretty straightforward.
One thing that’s worked well for us is setting up regular ETL jobs to pull data from Jira into PostgreSQL. We use a simple Python script for this, and it’s been reliable.
As for reporting, we’re using Metabase instead of Qlik, but I’ve heard Qlik works fine with PostgreSQL too. The ability to write custom SQL queries has been a game-changer for our reporting needs.
Just keep in mind you might need to put some thought into optimizing your queries as your data grows. We had to do some index tuning after a while, but it wasn’t too painful.
Hope this helps! Let me know if you have any specific questions about our setup.