January 23
TIL
- PGTune - calculate configuration for PostgreSQL based on the maximum performance for a given hardware configuration
- We input our server spec and then it will tell what the configuration we can use as starter
- Jitsu : Open Source Data Integration Platform
- It was a realtime data pipeline tools that has scripting capability
- It has a feature to track events that is emitted from an app
- It support JS to do data transformation
- built in Go
- What is dbt? | dbt Docs
- DBT is a tool that can transform data from an SQL source
- DBT has a Jinja template compiler, so we can add some Jinja logic into our SQL query. Example taken from the blog
- Ref: https://blog.getdbt.com/what-exactly-is-dbt/
select * from {{ref('really_big_table')}}
{% if incremental and target.schema == 'prod' %}
where timestamp >= (select max(timestamp) from {{this}})
{% else %}
where timestamp >= dateadd(day, -3, current_date)
{% endif %}
- Gerrit Code Review | Gerrit Code Review
- This is a code review tool used by Google
- Quite interesting, have many features
- One of them are Go: status:open -is:wip · Gerrit Code Review