Actuarial Outpost
 
Go Back   Actuarial Outpost > Actuarial Discussion Forum > Careers - Employment
FlashChat Actuarial Discussion Preliminary Exams CAS/SOA Exams Cyberchat Around the World Suggestions



Reply
 
Thread Tools Display Modes
  #1  
Old 08-25-2017, 07:01 PM
Colonel Smoothie's Avatar
Colonel Smoothie Colonel Smoothie is online now
Member
CAS
 
Join Date: Sep 2010
College: Jamba Juice University
Favorite beer: AO Amber Ale
Posts: 45,880
Default Big Data thread

This thread is to discuss applications of Spark, Scala, Hadoop, and other big data technologies at the workplace.

Everyone except Riley is invited to this thread. Thanks!
__________________
Recommended Readings for the EL Actuary || Recommended Readings for the EB Actuary

Quote:
Originally Posted by Wigmeister General View Post
Don't you even think about sending me your resume. I'll turn it into an origami boulder and return it to you.

Last edited by Colonel Smoothie; 10-09-2017 at 07:42 PM..
Reply With Quote
  #2  
Old 08-25-2017, 07:16 PM
JMO's Avatar
JMO JMO is offline
Carol Marler
Non-Actuary
 
Join Date: Sep 2001
Location: Back home again in Indiana
Studying for Nothing actuarial.
Posts: 36,767
Default

Quote:
Originally Posted by Colonel Smoothie View Post
I need to learn Spark and Scala for my job. Everyone except Riley is invited to this thread. Thanks!
__________________
Carol Marler, "Just My Opinion"

Pluto is no longer a planet and I am no longer an actuary. Please take my opinions as non-actuarial.


My latest favorite quotes, updated Feb 15, 2018. Hmmm. It's been quite a while.

Spoiler:
I should keep these four permanently.
Quote:
Originally Posted by rekrap View Post
JMO is right
Quote:
Originally Posted by campbell View Post
I agree with JMO.
Quote:
Originally Posted by Westley View Post
And def agree w/ JMO.
Quote:
Originally Posted by MG View Post
This. And everything else JMO wrote.
And this all purpose permanent quote:
Quote:
Originally Posted by Dr T Non-Fan View Post
Yup, it is always someone else's fault.
MORE:
Quote:
Originally Posted by PeppermintPatty View Post
But sometimes you get someone who has that charming mix of "don't care" and "don't get it", and there's just not much you can do.
Quote:
Originally Posted by Bro View Post
I recommend you get perspective.
Quote:
Originally Posted by Enough Exams Already View Post
Dude, you can't fail a personality test. It just isn't that kind of test.
Reply With Quote
  #3  
Old 08-25-2017, 07:33 PM
AMedActuary AMedActuary is offline
Member
SOA
 
Join Date: May 2007
College: UCLA Alumni
Posts: 374
Default

What resources are you using? Websites? Books? Articles?
Reply With Quote
  #4  
Old 08-25-2017, 08:11 PM
redearedslider's Avatar
redearedslider redearedslider is offline
Member
CAS
 
Join Date: Oct 2015
Posts: 12,446
Default

Quote:
Originally Posted by AMedActuary View Post
What resources are you using? Websites? Books? Articles?


I've always been wary of self teaching things without a vetted curricula to work through or something because you might end up with critical holes in knowledge.

Also how big is big data?
__________________
Quote:
Originally Posted by Abraham Weishaus View Post
ASM does not have a discussion of stimulation, but considering how boring the manual is, maybe it would be a good idea.
Reply With Quote
  #5  
Old 08-26-2017, 12:45 PM
Colonel Smoothie's Avatar
Colonel Smoothie Colonel Smoothie is online now
Member
CAS
 
Join Date: Sep 2010
College: Jamba Juice University
Favorite beer: AO Amber Ale
Posts: 45,880
Default

Quote:
Originally Posted by AMedActuary View Post
What resources are you using? Websites? Books? Articles?
All of them. I started using MS Azure for Hive which makes it really easy to set up. For that I used the online docs since Azure changes so quickly that even books that are 1 year old are out of date.

I'm currently reading Learning Spark which is just 270 pages long.

Stack Overflow for ad hoc problems that are hard to look up.
__________________
Recommended Readings for the EL Actuary || Recommended Readings for the EB Actuary

Quote:
Originally Posted by Wigmeister General View Post
Don't you even think about sending me your resume. I'll turn it into an origami boulder and return it to you.
Reply With Quote
  #6  
Old 08-26-2017, 12:46 PM
Colonel Smoothie's Avatar
Colonel Smoothie Colonel Smoothie is online now
Member
CAS
 
Join Date: Sep 2010
College: Jamba Juice University
Favorite beer: AO Amber Ale
Posts: 45,880
Default

Quote:
Originally Posted by redearedslider View Post


I've always been wary of self teaching things without a vetted curricula to work through or something because you might end up with critical holes in knowledge.

Also how big is big data?
I'm not sure. But I'm working with data sets that are a few TB in size. A lot of it is sensor data from IoT related things like on board vehicle sensors or hospital equipment.
__________________
Recommended Readings for the EL Actuary || Recommended Readings for the EB Actuary

Quote:
Originally Posted by Wigmeister General View Post
Don't you even think about sending me your resume. I'll turn it into an origami boulder and return it to you.
Reply With Quote
  #7  
Old 08-26-2017, 04:21 PM
Colonel Smoothie's Avatar
Colonel Smoothie Colonel Smoothie is online now
Member
CAS
 
Join Date: Sep 2010
College: Jamba Juice University
Favorite beer: AO Amber Ale
Posts: 45,880
Default

Quote:
Originally Posted by redearedslider View Post


I've always been wary of self teaching things without a vetted curricula to work through or something because you might end up with critical holes in knowledge.

Also how big is big data?
You have to move away from that mindset as a professional. Formal study programs are like cookie cutters. They oftentimes have information that is never used and then also lack information that isn't specialised enough for your practice area. But, if you want formality, just look at university websites for syllabuses.

A good deal of self awareness in where your strengths and weaknesses are is a useful skill to have in identifying what material you need to learn.
__________________
Recommended Readings for the EL Actuary || Recommended Readings for the EB Actuary

Quote:
Originally Posted by Wigmeister General View Post
Don't you even think about sending me your resume. I'll turn it into an origami boulder and return it to you.
Reply With Quote
  #8  
Old 08-30-2017, 11:16 AM
Colonel Smoothie's Avatar
Colonel Smoothie Colonel Smoothie is online now
Member
CAS
 
Join Date: Sep 2010
College: Jamba Juice University
Favorite beer: AO Amber Ale
Posts: 45,880
Default

I'm not a big fan of the Learning Spark book. It started out well and I like the approach of expressing each example in three different languages, but the examples are really weak and lack context (often just performed on random sets of integers). Also, the book starts showing some examples that aren't represented in all three languages, so there might be a Java version, which I don't understand but not a Python version, which I do understand.
__________________
Recommended Readings for the EL Actuary || Recommended Readings for the EB Actuary

Quote:
Originally Posted by Wigmeister General View Post
Don't you even think about sending me your resume. I'll turn it into an origami boulder and return it to you.
Reply With Quote
  #9  
Old 08-30-2017, 12:32 PM
Abelian Grape's Avatar
Abelian Grape Abelian Grape is offline
Meme-ber                         Meme-ber
CAS
 
Join Date: Jul 2014
Posts: 38,868
Default

pred anal too?
Reply With Quote
  #10  
Old 08-30-2017, 02:04 PM
Colonel Smoothie's Avatar
Colonel Smoothie Colonel Smoothie is online now
Member
CAS
 
Join Date: Sep 2010
College: Jamba Juice University
Favorite beer: AO Amber Ale
Posts: 45,880
Default

Yeah
__________________
Recommended Readings for the EL Actuary || Recommended Readings for the EB Actuary

Quote:
Originally Posted by Wigmeister General View Post
Don't you even think about sending me your resume. I'll turn it into an origami boulder and return it to you.
Reply With Quote
Reply

Tags
le data science, size matters, yuge data

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


All times are GMT -4. The time now is 05:25 PM.


Powered by vBulletin®
Copyright ©2000 - 2018, Jelsoft Enterprises Ltd.
*PLEASE NOTE: Posts are not checked for accuracy, and do not
represent the views of the Actuarial Outpost or its sponsors.
Page generated in 0.22303 seconds with 9 queries