Place potatoes in a medium saucepan and cover with water. Bring to a boil and simmer until potatoes are very soft. Drain and set aside to cool.
Once potatoes are cool, mash with the oil, eggs, dill, salt and pepper. Stir in the potato starch and mix until thoroughly combined. Refrigerate for one hour.
Bring a large pot of soup or lightly salted water to a boil. Using a cookie scoop or your hands, form dough into rough balls shapes and drop into boiling water or soup. Boil for 5 to 6 minutes. Serve in the soup or on the side.