Both players were said to have picked groin problems in Den Haag's 2-0 home loss to NAC Breda in Saturday's Eredivisie encounter.
While right-back Ebuehi was forced off in the 67th minute, his Ivorian counterpart was dismissed in the 36th minute with the team down to a Mounir El Allouchi 18th-minute goal.
The defender's ouster made a comeback more difficult for the hosts with Thierry Ambrose putting the game beyond them three minutes later.
Ebuehi is part of the 28-man squad drafted by Gernot Rohr for Nigeria's pre-World Cup friendlies against Poland and Serbia with Kanon in the Elephants' plan for a tune-up encounter with Togo slated for March 24.
A return date has not been set for both players, with Ebuehi's participation in their upcoming league encounter still in doubt.
Also, it is yet to be known if both players would be available for their countries' tune-ups.
Ebuehi and Kanon are suffering from an injury in their groin area, but it is not yet known how long their recovery will last, read a statement on club website.
Kanon will not take part against Excelsior due to his red card against NAC anyway.
Ebuehi and Kanon are also among the pre-selection of Nigeria and Ivory Coast respectively for the coming international break, which will take place after the coming game.