settingsLogin | Registersettings

[openstack-dev] [Ceilometer] Real world experience with Ceilometer deployments - Feedback requested

0 votes

Is Ceilometer ready for prime time?

I would be interested in hearing from people who have deployed OpenStack
clouds with Ceilometer, and their experience. Some of the topics I am
looking for feedback on are:

  • Database Size
  • MongoDB management, Sharding, replica sets etc.
  • Replication strategies
  • Database backup/restore
  • Overall useability
  • Gripes, pains and problems (things to look out for)
  • Possible replacements for Ceilometer that you have used instead

If you are willing to share - I am sure it will be beneficial to the
whole community.

Thanks in Advance

With best regards,

Maish Saidel-Keesing
Platform Architect
Cisco


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
asked Feb 11, 2015 in openstack-dev by maishsk_at_maishsk.c (3,000 points)   1 4 7
retagged Mar 6, 2015 by admin

2 Responses

0 votes

Hi Mash,

we dropped Ceilometer as the core tool to gather metrics for our rating and
billing system. I must admit it has improved, but I think it's broken by
design: a metering and monitoring system is not the same thing.

We have built a component that directly listens from rabbit notification
tools (a-la-Stacktach). This tool stores the all events in a database (but
anything could work, it's just a logging system) and then we process these
events and store them in a datamart style database every hour. The rating
and billing system reads this database and process it every hour too. We
decided to implement this pipeline processing of data because we knew in
advance that processing such an amount of data was a challenge.

I think Ceilometer should be used just to trigger alarms for heat for
example, and something else should be used for rating and billing.

Cheers
Diego

--
Diego Parrilla
CEO
*www.stackops.com | * diego.parrilla@stackops.com |
+34 91 005-2164 | skype:diegoparrilla

On Wed, Feb 11, 2015 at 8:37 PM, Maish Saidel-Keesing maishsk@maishsk.com
wrote:

Is Ceilometer ready for prime time?

I would be interested in hearing from people who have deployed OpenStack
clouds with Ceilometer, and their experience. Some of the topics I am
looking for feedback on are:

  • Database Size
  • MongoDB management, Sharding, replica sets etc.
  • Replication strategies
  • Database backup/restore
  • Overall useability
  • Gripes, pains and problems (things to look out for)
  • Possible replacements for Ceilometer that you have used instead

If you are willing to share - I am sure it will be beneficial to the whole
community.

Thanks in Advance

With best regards,

Maish Saidel-Keesing
Platform Architect
Cisco


OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Feb 12, 2015 by =?UTF-8?Q?Diego_Parr (580 points)   1
0 votes

Hi,
My experience with Ceilometer is that MongoDB is/was a major bottleneck.
You need sharding + servers with lot of RAM. You need to set TTL on your
samples, and only save in DB the metrics that really mater to you. MongoDB
v3 should also help.

Regarding RabbitMQ pressure, I think this blueprint helps a lot
https://blueprints.launchpad.net/ceilometer/+spec/multiple-rabbitmq

And also, you should make your own tests because there has been a lot of
FUD around Ceilometer.

Jordan

On Thu, Feb 12, 2015 at 6:23 PM, Diego Parrilla Santamaría <
diego.parrilla.santamaria@gmail.com> wrote:

Hi Mash,

we dropped Ceilometer as the core tool to gather metrics for our rating
and billing system. I must admit it has improved, but I think it's broken
by design: a metering and monitoring system is not the same thing.

We have built a component that directly listens from rabbit notification
tools (a-la-Stacktach). This tool stores the all events in a database (but
anything could work, it's just a logging system) and then we process these
events and store them in a datamart style database every hour. The rating
and billing system reads this database and process it every hour too. We
decided to implement this pipeline processing of data because we knew in
advance that processing such an amount of data was a challenge.

I think Ceilometer should be used just to trigger alarms for heat for
example, and something else should be used for rating and billing.

Cheers
Diego

--
Diego Parrilla
CEO
*www.stackops.com | *
diego.parrilla@stackops.com | +34 91 005-2164 | skype:diegoparrilla

On Wed, Feb 11, 2015 at 8:37 PM, Maish Saidel-Keesing <maishsk@maishsk.com

wrote:

Is Ceilometer ready for prime time?

I would be interested in hearing from people who have deployed OpenStack
clouds with Ceilometer, and their experience. Some of the topics I am
looking for feedback on are:

  • Database Size
  • MongoDB management, Sharding, replica sets etc.
  • Replication strategies
  • Database backup/restore
  • Overall useability
  • Gripes, pains and problems (things to look out for)
  • Possible replacements for Ceilometer that you have used instead

If you are willing to share - I am sure it will be beneficial to the
whole community.

Thanks in Advance

With best regards,

Maish Saidel-Keesing
Platform Architect
Cisco


OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Feb 12, 2015 by Jordan_Pittier (3,060 points)   2 4
...