Are Lambda and Beanstalk considered PaaS?

Not quite. AWS Lambda falls under the serverless (Functions as a Service) model, where the underlying platform isn't managed or configured by the customer. Elastic Beanstalk falls under Platform as a Service, because customers have some control over the platform even though AWS manages the underlying infrastructure.