Electron mass enhancement and magnetic phase separation near the Mott transition in double-layer ruthenates