How to Spark FAIR scheduler

[@1UniverseGames]

I have one question, how can i create a pyspark code for a single node level task scheduler from a DAGScheduler in python? do you have any mini source code for this? I just wanna try with for single node one task scheuler instead multi node and multi task scheduler from a DAGScheduler?

[@tadastadux]

Is it possible to do the same using pySpark (not scala)?

[@manpreet224u]

+1 on the above question. Any thoughts @supergloo?

[@itsyashagrawal]

+1 on the above question

[@saurav0777]

I have tried to used the fair scheduler but when i checked the stages on spark UI i saw active stages and running tasks in only FIFO scheduler and there is no task and active stages in Fair scheduler...

[@Supergloo]

how can I repeat?

[@saurav0777]

supergloo you can ignore my ask I have just resolved it by defining spark.scheduler.pool inside the application..thanks for your revert.