Character Introduction Critique

‘Kay, this is actually an excerpt from one of my historical fiction novels that I wrote some time ago. It’s pretty much the introductory scene for my second main character, and I’d like to know what you guys think.
Pretty much all you need to know is that he’s supposed to be mysterious— I delve deeper into his actual personality a little later in the book, but technically speaking this is his first scene. Anyway, there’s been mystery building up around his house (the ‘little house’ mentioned in the excerpt) and the strange owner everyone says inhabits it, but no one ever sees.
Without further ado, here it is.

Long after Mr. Prescott’s household, indeed all of respectable London, had gone to sleep, while the street lamps burned dim and fitful in the foggy atmosphere and the dark pressed in upon the small pinpoints of light hungrily, a black carriage turned into the street upon which Mr. Prescott resided. It was a commonplace carriage; indeed, a common cab, but it was out rather late for one of its kind. It rattled quietly down the rows of shuttered houses, and finally came to a halt before the little brick house with green shutters just opposite the lawyer’s dwelling. The driver, his collar pulled up high over his cheeks to shield himself from the biting early autumn air, twisted around on his seat and saw the door of his cab open quietly, black against the lighted sidewalk under the street lamp. The passenger appeared against that light suddenly; a tall man in a black hat and a long, dark cloak. Closing the door after himself, the man stopped and took something out of his pocket, then held his hand out to the cabby, who had jumped down from the box and stood beside him. The cabby took his fare with a gruff thanks, and pocketing it stood watching his passenger curiously. The man was tall indeed; very tall. Without his hat he must have been at least six feet three inches, and he carried himself well and confidently. “Sir,” the cabby ventured as the man began to ascend the steps to the little house, “Sir, if I may ask, what is your name? I should like to know; I keep a record of my customers.”
The man halted, and stood for a moment with one hand on the iron railing. Suddenly turning his head, he afforded the curious cabby a very sharp view of a clearly cut, handsome profile, with a somewhat long, perfectly straight nose, a well molded forehead, and a sensitive but firm mouth.“I had rather not give my name to anyone just now, my man,” he replied. “You are quite welcome to record my address if you wish or think it necessary.”
“I’ll do that then,” the cabby answered, and swung himself back up into the driver’s seat, taking up the reins and urging his horse away into the night. His passenger ascended the rest of the way up the front steps, stopping on the top step and taking a small key out of his pocket. This he pushed into the lock, and with great difficulty managed to turn it. Then, pocketing the key again, he went into the dark house and shut the door.

Some of the stylistic stuff needs work— like, all the adverbs and adjectives. *wince* I wrote it a while back and have improved since then, so you don’t have to feel obligated to point that out. You can, but you don’t have to. 🙂 I just want your thoughts on the actual scene.
Thanks in advance. You guys are awesome.