Your imagination is limited. Here, I will help you.
Glass does not require acids, nor does it require rubber. All you need to make glass is a silica source, a pot furnace, and a flux (Salt and calcium carbonate are quite suitable.) in addition to the obvious need for fuel.
You use this glass to blow a modified alembic and retort. On the retort, you have a small opening to which you can affix a bellows. The long neck of the retort is fitted with wood cork at the end, and inserted into a modified alemic. This alembic is very tall and narrow. The retort's neck droops like you would expect from a medival style of this device, but then angles sharply 90 degrees. The neck is sufficiently long that filling the alembic will not cause backflow of water into the retort.
You place raw sulfur into the retort, and distilled water into the alembic. You ignite the sulfur, then attach a bellows to the air intake hole on the retort. You then pump air in viggorously. This continues the combustion of the sulfur, producing fume. The fume is routed through the neck of the retort into the bottom of the alembic via the 90 degree bend, and through the wood cork junction. Due to the small size of the aperature, the pressurized air disperses into a "spray" of bubbles in the distilled water. when then rise up through the tall cylendar like shape of the alembic.
All you need is thus glass (made from sand, salt, and limestone), woodcork, and a bellows (made from boiled leather and wood.) As I said, you can substitute coal for refined sulfur, you just wont get as clean an acid.