@jnl I'd recommend life jacket, whistle, and paddling around low tide to start (if you get in trouble the ocean is pushing you back in). There's a "120" rule that the air+water temperatures (F, not C) should be 120 or greater. If it's less you should have on thermal protection (wet suit). TBH, if water temperature is <60F you should probably have a wet suit. If "your" estuary is the one I think it is I'd start inside the bridge until you're more comfortable.
@jnl Other things on my kayak checklist (some obvious, some not essential) are: cell phone case (floating), water shoes, hat, sunscreen, kayak gloves, glasses float, water, cookies, paddles (I forgot them once). Oh, check the wind direction as well as the tide - paddle against both to start so, again, you get pushed "home."
@jnl Final note: I'm totally jealous of your access to the water. I *would* paddle into Conception Bay (with the right wind and tide).