How do we use the new Observable Inputs inline? When I used them within markdown as below, they get put on their own line, because they come wrapped within a <form>.

The Observable Inputs aren’t designed to be used inline; they’re intended to be used at the top-level of a cell. If you want inline inputs I would suggest styling your own native inputs as this notebook does, or consider my Tangle notebook.