View Single Post
Old 11-07-2017, 01:26 AM
Colonel Smoothie's Avatar
Colonel Smoothie Colonel Smoothie is offline
Join Date: Sep 2010
College: Jamba Juice University
Favorite beer: AO Amber Ale
Posts: 48,466

Originally Posted by kevinykuo View Post
Why not R?
The main reason is that we're using Spark which supports 3 languages (Python, Scala, and Java). Our cloud computing service (Azure) offers an out-of-the-box solution for parallel processing - our datasets are a few TB in size which would be too much for R to handle on a single machine.

Azure also offers a parallel solution for R, which I haven't tried yet. I'm mainly using Spark because a big client of ours is using it.
Recommended Readings for the EL Actuary || Recommended Readings for the EB Actuary

Originally Posted by Wigmeister General View Post
Don't you even think about sending me your resume. I'll turn it into an origami boulder and return it to you.
Reply With Quote
Page generated in 0.08582 seconds with 9 queries