Finley Technologies, Inc.’s Post

View organization page for Finley Technologies, Inc., graphic

3,310 followers

💡 How has Finley's software evolved to handle customers that process millions of rows of loan data each day? Here's CTO Kevin Suh on the data processing challenges that the Engineering team has overcome!

Jason Kim

Software Engineer at Microsoft

2mo

Hi Kevin, this is a great illustration of a classic data engineering challenge. I love your explanation of how your team handled this. I just wanted to suggest you might want to checkout Azure Databricks or AWS EMR to run Spark jobs handle the big data. In the short term, it may be an overkill, but if your data size continues to grow, moving your jobs to Spark would make sense.

Like
Reply

To view or add a comment, sign in

Explore topics