I enjoy data engineering a lot; it’s a fun mixture of software engineering, big data, analytics/statistics, and improving important organization-level metrics like conversion and retention rates.

We piped data from our production databases (primarily Postgres), click streams, and some tools like Intercom into our data warehouse (initially Reshift, then BigQuery). There we used dbt for transformations. Mart data was exposed to our API Gateway, CDP, reverse ETL tools, and analytics tools like Hex to build visibility into our business!

We migrated from Tableau to Hex. Hex is a great notebook tool that allows you to mix SQL and Python to query just about any data you have anywhere, and quickly build charts and dashboards