Twitter Inc. Chief Executive Dick Costolo continues to clean house after a troubled start as a public company, replacing his finance chief with the Goldman Sachs Group Inc. investment banker who helped shepherd the IPO in November.

The hiring of Anthony Noto, a hard-charging banker with deep ties to Wall Street, furthers Twitter’s executive shuffling amid increasing investor skepticism over whether the microblogging site can…