• This site is a private, non-commercial website. As such, you're welcome here as long as you were invited. If you would like an invite, reach out to Cliff Spark

In-Memory C++ Leap in Blockchain Analysis

  • Thread starter Thread starter caudena
  • Start date Start date
C

caudena

Hey HN
We’re the core engineering team at Caudena (which is used globally by investigative and intelligence agencies, including: Europol, Interpol, BKA, DHS, IRS-CI, FBI, NPA and others), and we just released the technical details behind Prism - our real-time, in-memory C++ database for blockchain analysis.
To tackle the massive scale and complexity of blockchain data, we had to get creative with low-level engineering:
  • We utilize barebone servers with 2TB RAM and 48 Cores.
  • Implemented lock-free concurrent data structures
  • Developed a custom memory management system
  • Leveraging CPU-level vectorization
  • Built a custom in-memory columnar/graph database from scratch
We’d love to AMA about:
  • the engineering choices we made
  • crazy optimizations that paid off
  • pitfalls we hit
Ask us anything about scaling, memory trade-offs, building real-time analytics on immutable data, or the crypto-forensics space.
Looking forward to a great convo!


Comments URL: In-Memory C++ Leap in Blockchain Analysis | Hacker News

Points: 62

# Comments: 52

Continue reading...
 
Back
Top