The secret to analysing large, complex datasets quickly and productively? Constraint

By Medium - 2021-03-01

Description

TL:DR: Sometimes you have so much data you can waste hours exploring without answering the important questions. I share tips on how to analyse large complex datasets productively by constraining…

Summary

  • Sometimes you have so much data you can waste hours exploring without answering the important questions.
  • They may be able to advise what in the data is interesting and what isn’t.
  • Keep detailed notes of what you tryWith so many t-tests and regression models flying about, you might end up forgetting you ran some analysis previously and end up running it again!
  • Any data stuff not done after this time will have to wait for another day.

 

Topics

  1. Backend (0.36)
  2. Database (0.2)
  3. Security (0.11)

Similar Articles

7 Ways Your Data Is Telling You It’s a Graph

By Neo4j Graph Database Platform - 2015-12-23

Watch (or read) Senior Project Manager Karen Lopez’s GraphConnect presentation on the signs that your data is actually a graph and needs a graph database.

15 Essential Steps To Build Reliable Data Pipelines

By Medium - 2020-12-01

If I learned anything from working as a data engineer, it is that practically any data pipeline fails at some point. Broken connection, broken dependencies, data arriving too late, or some external…

Data Science Learning Roadmap for 2021

By freeCodeCamp.org - 2021-01-12

Although nothing really changes but the date, a new year fills everyone with the hope of starting things afresh. If you add in a bit of planning, some well-envisioned goals, and a learning roadmap, yo ...