First Hand: Equip Oliver instead of Ogier from the deck during the end phase. Link Charles should also be the one doing the equipping of the two cards, not Synchro Charles so that Link Charles gains Oliver's targeting protection. If you already equipped Oliver to Charles during the main phase, then Maugis is the second priority, so it can be sent as the cost for either Gearfried or Link Charles negation, then you get a draw. Ogier isn't as useful while equipped. Most destruction effects will be negatable by Link Charles and Gearfried anyway which is why I recommend prioritizing the other two. Also, I have found that turboing out the Ultimate Flame Swordsman to be an overextension on turn 1 when going first, the pop is nice but its true strength is when it attacks. So it often makes for a better turn 3 follow up to go in for game or atk boost over some problem monster. Or a pivot if your combo gets interrupted and can't get to Charles. An endboard of Gearfried, 2 Link Charles, Angelica, and a bunch of equips/museum will win most games.

Geezs

Wait, you can overlay museum over museum to activate it's effects again? That's a new one

What do you think about running Angelica's ring? It can be easily a brick in your hand, but since you don't have it to your hand, you can activate every time Captain Roland's effect on summon that says that during the End Phase you can send an equip spell from deck to grave, then add a warrior monster to your hand (for followup, that card can be the little Roland), then also in the End Phase, big Charles will equip Angelica's Ring from grave, so you end on an other magic interruption in addition to the other one/two spell&trap negate by Charlemagne(S).

Can you share the decklist please?