Stocks opened higher on Thursday as the Senate got closer to voting on a bill aimed at overhauling the U.S. tax code.

The Dow Jones industrial average rose 115 points, breaking above 24,000 for the first time, with Goldman Sachs leading advancers on the 30-stock index.

The S&P 500 reached an all-time high at the open, advancing 0.4 percent, with financials among the best-performing sectors.

The Nasdaq composite rose 0.3 percent, rebounding from a 2 percent decline in the previous session. Read more at CNBC