A pilonidal cyst is a swelling that starts under the skin on the sacrum near the tail bone. It may look like a small dimple. Because it often has an opening to the surface, it may become infected with normal skin bacteria. Here's what you should know.