Dwarves
Memo
Home
Consulting
Earn
Hiring
Changelog
OGIFs
Night mode
Pinned
§ Brainery 🧠
§ Prompt Engineering
§ Data Engineering
Focus on delivery
Go the extra mile
Home
Careers
Consulting
Culture
Earn
Fund
Handbook
Opensource
Playbook
Radar
Research
Updates
Popular Tags
Dwarves
Memo
Search note
⌘
K
#data
B
Building a data-driven project reporting system: A lens into modern data engineering
data-engineering
system-design
architecture
Bloom filter
data-structure
bloom-filter
big-o
Building better Binance transfer tracking
data
DeFi
fintech
§ Brainery 🧠
brainery
build-log
knowledge-management
Building data pipeline for OGIF transcriber
AI
agents
data
Building a data archive and recovery strategy for high-volume trading system
data
blockchain
finance
C
collecting-analytics-data-is-not-the-same-as-doing-research
strategy
data
Chunking strategies to overcome context limitation in LLM
AI
LLM
vector-database
D
data-erd
data
diagram
data-lifecycle
data
database-sharding
engineering
database
sharding
§ Data Engineering
data-engineering
data
MoC
Data pipeline design framework
data
data-pipeline
Database design circular
database
SQL
data-modeling
Designing a model with dynamic properties
system-design
database-modelling
Data flow in Brainery
brainery
data-flow
timescaledb
Database design and philosophy
brainery
database-design
timescaledb
Database hardening for a trading platform
database
blockchain
fintech
E
Energy - data engineering
data
career
Evolutionary database design: managing change and scaling with the system
software-development
database-management
I
Introduction to CRDT
distributed-system
crdt
data-types
Implementing data snapshot pattern to persist historical data
data
blockchain
fintech
L
¶ Local-first software
local-first
crdt
data-synchronization
M
Multi-MCP data integration - receiving data from other MCP servers
AI
MCP
data
Materialized view pattern
data
materialized-view
SQL
Multi-column index in DB
database
multi-column-index
index
Managing dataflow and SQL database with concurrency control
rd
data
¶ MapReduce
data
mapreduce
distributed
Multimodal: in rag
LLM
vector-database
RAG
Migrate regular tables into TimescaleDB hypertables to improve query performance
data
timescaledb
blockchain
N
Natural language to database queries: Text-to-MongoDB
AI
LLM
mongodb
P
Project reports system: a case study
AI
agents
data
Promoting raw data to insight
brainery
data-pipeline
knowledge-base
Q
Quick learning vector database
data
vector-database
database
Query caching for large language models
AI
LLM
vector-database
R
Render optimization in data-fetching libraries
engineering
frontend
data-fetching
React server components, NextJs route and data fetching
frontend
react
nextjs
Reconstructing historical trading PnL: a data pipeline approach
data
blockchain
fintech
S
sql-practices
SQL
data
practice
Sql and how it relates to disk reads and writes
engineering
data-engineering
sequential-reads
Sql practices orm vs plain sql
SQL
database
SQL saragable queries and their impact on database performance
SQL
database
sargable-queries
Slice and array in Golang
data-structures
golang
Storing long-term memory in ChatGPT using VectorDB
AI
LLM
vector-database
Select vector database for LLM
AI
vector-database
LLM
T
#3 Tom Nguyen on remote working
data-engineer
life-at-dwarves
remote
Tracking Bitcoin-altcoin performance indicators in BTC hedging strategy
data
blockchain
fintech
Transfer mapping: enhancing loggers for better transparency
data
blockchain
fintech
V
Visualizing crypto market performance: BTC-Alt dynamic indicators in Golang
data
blockchain
fintech