Turns out I have to let pelican support markdown explicitly by

python -m pip install "pelican[markdown]"

Per the doc that I don't read (of course).