Apache Spark Community Feedback initiative

Hi,

User feedbacks are very precious learning resources. This is especially true for the technologies that can be used in different ways. Apache Spark belongs to this category since it can be integrated in data pipelines in many different ways, with different data stores, and for different purposes. You will find all of this in technical blog posts, local meetups, and official summits. However, you will need some time to find them. Also, they present the projects at a specific point of time and rarely give some follow-up information. To address these 2 points I decided to start Apache Spark Community Feedback initiative.

The goal of the Apache Spark Community Feedback initiative is to get the feedback of the community members who used Apache Spark and want to share their experience by answering on some short questions. Since it's also important to know where Apache Spark doesn't fit, the initiative is also open for the ones of you who considered to use Apache Spark and finally opted for another solution.

Each feedback will be summarized as an interview page published in the new "Apache Spark Community Feedback" category on waitingforcode.com. I hope that at the end this place will group the best practices for industrialization, optimization, organization and monitoring of Apache Spark projects.

The initiative is completely private, not supported by any vendor nor any other official organization. All results will be shared for free on waitingforcode.com as interviews.

>> Interviews ? Do you have an example ? Yes, to give you a better idea of the outcome, I prepared a sample interview page.

I'm interested in ! What I have to do now ?

1. You fill in the form on Google Forms https://forms.gle/sjSWPKmudhM6a3776. If you prefer, we can do a call instead :)
2. I prepare the interview page, eventually ask you some extra questions, and share it with you before publishing
3. You verify the interview page
4. Depending on your answer, I publish or rework the page
5. After the publication, once a month, I will send you a short message to see whether everything you shared is still up to date. If not, we will start our iteration from the point 2. Otherwise, I will send you a new reminder one month later.

If you know somebody who would like to participate, please forward this page to him. If you prefer to call me and answer the form, it's also possible. I will prepare the transcript.