What is Spark and PySpark and what can I do with it?
It kind of baffled me because I am very much used to thinking and talking in code and my mind just kept going back to technical terms, so I believe I didn’t do a great job in the very limited time I had. Let’s try this one more time, using the “impossible” homework example, for the sake of that one person who asked me and because I believe that explaining things as simply as possible is a great skill to develop.
Click the link below to read the full article that explains the over-simplified basic thinking behind Apache Spark and many similar frameworks and systems, e.g. horizontal or vertical data “sharding” :