Why didn't Inoue fight at flyweight?

I'm looking over Naoya Inoue's resume, and one flaw in his resume is he skipped flyweight and went straight to junior bantamweight.

Why didn't he fight at flyweight? He could have easily won a...