"Temple wasn't even in my top five until a couple of days ago," the 17-year-old said.
Temple defensive coordinator Chuck Heater impressed Brown and sparked his curiosity, so Brown visited the Owls' Eldberg-Olson Football Complex twice last week.
After his second visit, which occurred Friday, Brown was sold on Temple.
"I actually was going to commit to Rutgers at [the Scarlet Knights'] spring game," he said. "But my mom wasn't able to go because she fell down the step and hurt herself.
"So I ended up delaying my commitment. And this ended up working out."
After visiting the campus, Brown believes that Temple is a hidden gem. He's also impressed with the Owls coaching staff, primarily second-year head coach Steve Addazio and Heater.
Addazio and Heater were both assistant coaches at Florida.
"You don't have to go to Rutgers, you can go right here," Sean Brown said. "We are not North Jersey people. We are basically a step over from Philly.
"We love the Eagles. We love Temple basketball. We like all that. So why not stay here and have a chance to make a change?"
Brown, a three-star recruit by both Rivals.com and Scout.com, had 87 tackles, six sacks and four forced fumbles last season.
He is regarded as New Jersey's 15th-best college prospect in the class of 2013 by Rivals.com.
Two Owls noted. Temple senior running back Matt Brown and senior placekicker/punter Brandon McManus are on the College Football Performance Awards watch lists.
Brown is on the all-purpose watch list. McManus is on both the placekicker and specialist lists.
Contact Keith Pompey at 215-854-2939, kpompey@phillynews.com, or follow on Twitter @pompeysgridlock. Read his blog, "Owls Inq," at philly.com/owlsinq.