Actuarial Outpost
 
Go Back   Actuarial Outpost > Actuarial Discussion Forum > Careers - Employment
FlashChat Actuarial Discussion Preliminary Exams CAS/SOA Exams Cyberchat Around the World Suggestions

DW Simpson Global Actuarial & Analytcs Recruitment
Download our 2016 Actuarial Salary Survey
now with state-by-state salary information!


Reply
 
Thread Tools Display Modes
  #1  
Old 08-25-2017, 06:01 PM
Colonel Smoothie's Avatar
Colonel Smoothie Colonel Smoothie is online now
Member
CAS
 
Join Date: Sep 2010
College: Jamba Juice University
Favorite beer: AO Amber Ale
Posts: 44,693
Default Big Data thread

This thread is to discuss applications of Spark, Scala, Hadoop, and other big data technologies at the workplace.

Everyone except Riley is invited to this thread. Thanks!
__________________
Recommended Readings for the EL Actuary || Recommended Readings for the EB Actuary

Quote:
Originally Posted by Wigmeister General View Post
Don't you even think about sending me your resume. I'll turn it into an origami boulder and return it to you.

Last edited by Colonel Smoothie; 10-09-2017 at 06:42 PM..
Reply With Quote
  #2  
Old 08-25-2017, 06:16 PM
JMO's Avatar
JMO JMO is offline
Carol Marler
Non-Actuary
 
Join Date: Sep 2001
Location: Back home again in Indiana
Studying for Nothing actuarial.
Posts: 36,310
Default

Quote:
Originally Posted by Colonel Smoothie View Post
I need to learn Spark and Scala for my job. Everyone except Riley is invited to this thread. Thanks!
__________________
Carol Marler, "Just My Opinion"

Pluto is no longer a planet and I am no longer an actuary. Please take my opinions as non-actuarial.


My latest favorite quotes, updated Oct 13, 2017.

Spoiler:
I should keep these four permanently.
Quote:
Originally Posted by rekrap View Post
JMO is right
Quote:
Originally Posted by campbell View Post
I agree with JMO.
Quote:
Originally Posted by Westley View Post
And def agree w/ JMO.
Quote:
Originally Posted by MG View Post
This. And everything else JMO wrote.
MORE:
Quote:
Originally Posted by Bro View Post
I recommend you get perspective.
Quote:
Originally Posted by Enough Exams Already View Post
Dude, you can't fail a personality test. It just isn't that kind of test.
Quote:
Originally Posted by Locrian View Post
I'm disappointed I don't get to do both.
Quote:
Originally Posted by elleminopee View Post
For me, I take accusations of simplicity as more of a compliment than an insult. When the level of complexity in your model is more than you can validate, you are wasting your time.
Reply With Quote
  #3  
Old 08-25-2017, 06:33 PM
AMedActuary AMedActuary is offline
Member
SOA
 
Join Date: May 2007
College: UCLA Alumni
Posts: 359
Default

What resources are you using? Websites? Books? Articles?
Reply With Quote
  #4  
Old 08-25-2017, 07:11 PM
redearedslider's Avatar
redearedslider redearedslider is offline
Member
CAS
 
Join Date: Oct 2015
Posts: 11,696
Default

Quote:
Originally Posted by AMedActuary View Post
What resources are you using? Websites? Books? Articles?


I've always been wary of self teaching things without a vetted curricula to work through or something because you might end up with critical holes in knowledge.

Also how big is big data?
__________________
Quote:
Originally Posted by Abraham Weishaus View Post
ASM does not have a discussion of stimulation, but considering how boring the manual is, maybe it would be a good idea.
Reply With Quote
  #5  
Old 08-26-2017, 11:45 AM
Colonel Smoothie's Avatar
Colonel Smoothie Colonel Smoothie is online now
Member
CAS
 
Join Date: Sep 2010
College: Jamba Juice University
Favorite beer: AO Amber Ale
Posts: 44,693
Default

Quote:
Originally Posted by AMedActuary View Post
What resources are you using? Websites? Books? Articles?
All of them. I started using MS Azure for Hive which makes it really easy to set up. For that I used the online docs since Azure changes so quickly that even books that are 1 year old are out of date.

I'm currently reading Learning Spark which is just 270 pages long.

Stack Overflow for ad hoc problems that are hard to look up.
__________________
Recommended Readings for the EL Actuary || Recommended Readings for the EB Actuary

Quote:
Originally Posted by Wigmeister General View Post
Don't you even think about sending me your resume. I'll turn it into an origami boulder and return it to you.
Reply With Quote
  #6  
Old 08-26-2017, 11:46 AM
Colonel Smoothie's Avatar
Colonel Smoothie Colonel Smoothie is online now
Member
CAS
 
Join Date: Sep 2010
College: Jamba Juice University
Favorite beer: AO Amber Ale
Posts: 44,693
Default

Quote:
Originally Posted by redearedslider View Post


I've always been wary of self teaching things without a vetted curricula to work through or something because you might end up with critical holes in knowledge.

Also how big is big data?
I'm not sure. But I'm working with data sets that are a few TB in size. A lot of it is sensor data from IoT related things like on board vehicle sensors or hospital equipment.
__________________
Recommended Readings for the EL Actuary || Recommended Readings for the EB Actuary

Quote:
Originally Posted by Wigmeister General View Post
Don't you even think about sending me your resume. I'll turn it into an origami boulder and return it to you.
Reply With Quote
  #7  
Old 08-26-2017, 03:21 PM
Colonel Smoothie's Avatar
Colonel Smoothie Colonel Smoothie is online now
Member
CAS
 
Join Date: Sep 2010
College: Jamba Juice University
Favorite beer: AO Amber Ale
Posts: 44,693
Default

Quote:
Originally Posted by redearedslider View Post


I've always been wary of self teaching things without a vetted curricula to work through or something because you might end up with critical holes in knowledge.

Also how big is big data?
You have to move away from that mindset as a professional. Formal study programs are like cookie cutters. They oftentimes have information that is never used and then also lack information that isn't specialised enough for your practice area. But, if you want formality, just look at university websites for syllabuses.

A good deal of self awareness in where your strengths and weaknesses are is a useful skill to have in identifying what material you need to learn.
__________________
Recommended Readings for the EL Actuary || Recommended Readings for the EB Actuary

Quote:
Originally Posted by Wigmeister General View Post
Don't you even think about sending me your resume. I'll turn it into an origami boulder and return it to you.
Reply With Quote
  #8  
Old 08-30-2017, 10:16 AM
Colonel Smoothie's Avatar
Colonel Smoothie Colonel Smoothie is online now
Member
CAS
 
Join Date: Sep 2010
College: Jamba Juice University
Favorite beer: AO Amber Ale
Posts: 44,693
Default

I'm not a big fan of the Learning Spark book. It started out well and I like the approach of expressing each example in three different languages, but the examples are really weak and lack context (often just performed on random sets of integers). Also, the book starts showing some examples that aren't represented in all three languages, so there might be a Java version, which I don't understand but not a Python version, which I do understand.
__________________
Recommended Readings for the EL Actuary || Recommended Readings for the EB Actuary

Quote:
Originally Posted by Wigmeister General View Post
Don't you even think about sending me your resume. I'll turn it into an origami boulder and return it to you.
Reply With Quote
  #9  
Old 08-30-2017, 11:32 AM
Abelian Grape's Avatar
Abelian Grape Abelian Grape is offline
Meme-ber                         Meme-ber
SOA
 
Join Date: Jul 2014
Posts: 36,182
Default

pred anal too?
Reply With Quote
  #10  
Old 08-30-2017, 01:04 PM
Colonel Smoothie's Avatar
Colonel Smoothie Colonel Smoothie is online now
Member
CAS
 
Join Date: Sep 2010
College: Jamba Juice University
Favorite beer: AO Amber Ale
Posts: 44,693
Default

Yeah
__________________
Recommended Readings for the EL Actuary || Recommended Readings for the EB Actuary

Quote:
Originally Posted by Wigmeister General View Post
Don't you even think about sending me your resume. I'll turn it into an origami boulder and return it to you.
Reply With Quote
Reply

Tags
le data science, size matters

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


All times are GMT -4. The time now is 10:57 PM.


Powered by vBulletin®
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
*PLEASE NOTE: Posts are not checked for accuracy, and do not
represent the views of the Actuarial Outpost or its sponsors.
Page generated in 0.30913 seconds with 9 queries