Arsenal fell behind to PSG striker Edinson Cavani's header after just 42 seconds, frustrating Laurent Koscielny.
With just 42 seconds played the Gunners found themselves behind as Edinson Cavani nodded past David Ospina.
The Colombian goalkeeper made myriad brilliant saves to keep Arsenal level before Alexis Sanchez fired home an equaliser in the 78th minute.
Despite coming away from the Parc des Princes with a valuable point against the team that are most likely to challenge them for top spot in Group A, Koscielny still had regrets.
The centre-back pointed to the fact Arsenal also had to come from behind in their 2-1 victory over Southampton on Saturday.
"I think it's a good point but we came here with our ambition and we wanted to have the three points, but when we start like this it's difficult to play," said Koscielny in a post-match interview.
"Maybe in the final third we didn't find the good ball to score, but we came back. During the game against Southampton in the Premier League we slept and we need to change this in the future. We need to be strong from the first minute to the end.
"We did pretty well but if you start like this it's difficult."
Arsenal's next Champions League match is at home to Basel on September 28.