A Tale of Two.....Towns - First Sketch - UPDATED (Patreon)

Hello to you my wonderful patrons!
I wanted to kick off our first big project with some input from you guys.
Here is a sketch of the Town of.....(Suggestions welcome)

I have an idea for how is town might make an interesting location for your games but would love your help to flesh it out.
The premise of this project is that the town grew up around an important river crossing, a fortified bridge held by a military faction i.e. army, warrior priests, robber baron etc.
Traffic across the river is strictly controlled and is the only point for many miles where the river can be crossed.
This has led to rise of this town, united but separate. Two rival merchant guilds have grown up on either side of the river both vying for any advantage they can gain over the other. With the military faction playing both sides and making large amounts of money in the meantime.
With the limits on trade and traffic there is naturally a thriving black market convertly controlled by the Fisheries, a neutral faction of fisherman who can get goods and people across the river in small numbers for the right price.
That's as far as I have got. Let me know what you think!

All feedback on either the map itself or writings ideas equally welcome!


Here's a little timelapse of the sketch I did this morning :)

And here we are at 5 hour mark. Really starting to take shape :D. Thanks for the feedback so far!