The leaders of a House panel told Attorney General Eric Holder Wednesday that they had serious concerns about the Justice Department’s gathering of phone records at The Associated Press.