1) https://www.opensupports.com/
2)
Importance of change advisory board (CAB)
A change advisory board (CAB) is a group of people who meet regularly to review and approve changes to an organization's IT infrastructure. The CAB helps to ensure that changes are made in a controlled and orderly manner, and that they do not impact the business negatively.
The importance of a CAB can be summarized as follows:
- Ensures that changes are reviewed and approved by a group of experts: The CAB typically includes representatives from different areas of the organization, such as IT, business, and operations. This ensures that changes are reviewed from all angles and that any potential risks are identified and mitigated.
- Provides a forum for communication and collaboration: The CAB provides a forum for stakeholders to discuss changes and to reach consensus on the best course of action. This helps to ensure that changes are implemented smoothly and that everyone is on the same page.
- Helps to improve the quality of changes: The CAB can help to ensure that changes are well-planned, well-tested, and documented. This helps to reduce the risk of errors and problems.
- Helps to improve the efficiency of change management: The CAB can help to streamline the change management process and to identify opportunities for improvement. This can help to save time and money.
- Helps to build trust and credibility: The CAB can help to build trust and credibility between IT and the business. This is important for ensuring that changes are supported by the business and that they are implemented successfully.
Overall, the CAB is an important part of any organization's change management process. By ensuring that changes are reviewed and approved by a group of experts, the CAB helps to improve the quality, efficiency, and success of changes.
Here are some of the benefits of having a CAB:
- Improved decision-making: The CAB can help to improve decision-making by providing a forum for discussion and debate. This can help to ensure that all perspectives are considered and that the best possible decision is made.
- Increased visibility: The CAB can help to increase visibility of changes by providing a forum for communication and collaboration. This can help to ensure that everyone is aware of changes and that they are implemented smoothly.
- Reduced risk: The CAB can help to reduce risk by identifying and mitigating potential problems. This can help to prevent changes from impacting the business negatively.
- Improved efficiency: The CAB can help to improve efficiency by streamlining the change management process. This can help to save time and money.
- Increased compliance: The CAB can help to ensure that changes comply with all relevant regulations. This can help to protect the organization from fines and penalties.
If you are considering implementing a CAB in your organization, I recommend that you do the following:
- Define the scope of the CAB: The first step is to define the scope of the CAB. This will help to determine who should be involved and what issues should be discussed.
- Identify the members of the CAB: The next step is to identify the members of the CAB. The members should be experts from different areas of the organization, such as IT, business, and operations.
- Establish the meeting schedule: The CAB should meet regularly to review and approve changes. The meeting schedule should be agreed upon by all members.
- Develop the meeting agenda: The CAB should have a clear agenda for each meeting. This will help to ensure that the meeting is productive.
- Document the decisions: The decisions of the CAB should be documented. This will help to ensure that everyone is aware of the decisions that have been made.
By following these steps, you can ensure that your CAB is successful.
Installing Apache Zeppelin on a Hadoop Cluster
Apache Zeppelin(https://zeppelin.incubator.apache.org/) is a web-based notebook that enables interactive data analytics. You can make data-driven, interactive and collaborative documents with SQL, Scala and more.
This document describes the steps you can take to install Apache Zeppelin on a CentOS 7 Machine.
Steps
Note: Run all the commands as Root
Configure the Environment
Install Maven (If not already done)
cd /tmp/
wget https://archive.apache.org/dist/maven/maven-3/3.1.1/binaries/apache-maven-3.1.1-bin.tar.gz
tar xzf apache-maven-3.1.1-bin.tar.gz -C /usr/local
cd /usr/local
ln -s apache-maven-3.1.1 maven
Configure Maven (If not already done)
#Run the following
export M2_HOME=/usr/local/maven
export M2=${M2_HOME}/bin
export PATH=${M2}:${PATH}
Note: If you were to login as a different user or logout these settings will be whipped out so you won’t be able to run any mvn commands. To prevent this, you can append these export statements to the end of your ~/.bashrc file:
#append the export statements
vi ~/.bashrc
#apply the export statements
source ~/.bashrc
Install NodeJS
Note: Steps referenced from https://nodejs.org/en/download/package-manager/
curl --silent --location https://rpm.nodesource.com/setup_5.x | bash -
yum install -y nodejs
Install Dependencies
Note: Used for Zeppelin Web App
yum install -y bzip2 fontconfig
Install Apache Zeppelin
Select the version you would like to install
View the available releases and select the latest:
https://github.com/apache/zeppelin/releases
Override the {APACHE_ZEPPELIN_VERSION} placeholder with the value you would like to use.
Download Apache Zeppelin
cd /opt/
wget https://github.com/apache/zeppelin/archive/{APACHE_ZEPPELIN_VERSION}.zip
unzip {APACHE_ZEPPELIN_VERSION}.zip
ln -s /opt/zeppelin-{APACHE_ZEPPELIN_VERSION-WITHOUT_V_INFRONT} /opt/zeppelin
rm {APACHE_ZEPPELIN_VERSION}.zip
Get Build Variable Values
Get Spark Version
Running the following command
spark-submit --version
Override the {SPARK_VERSION} placeholder with this value.
Example: 1.6.0
Get Hadoop Version
Running the following command
hadoop version
Override the {HADOOP_VERSION} placeholder with this value.
Example: 2.6.0-cdh5.9.0
Take the this value and get the major and minor version of Hadoop. Override the {SIMPLE_HADOOP_VERSION} placeholder with this value.
Example: 2.6
Build Apache Zeppelin
Update the bellow placeholders and run
cd /opt/zeppelin
mvn clean package -Pspark-{SPARK_VERSION} -Dhadoop.version={HADOOP_VERSION} -Phadoop-{SIMPLE_HADOOP_VERSION} -Pvendor-repo -DskipTests
Note: this process will take a while
Configure Apache Zeppelin
Base Zeppelin Configuration
Setup Conf
cd /opt/zeppelin/conf/
cp zeppelin-env.sh.template zeppelin-env.sh
cp zeppelin-site.xml.template zeppelin-site.xml
Setup Hive Conf
# note: verify that the path to your hive-site.xml is correct
ln -s /etc/hive/conf/hive-site.xml /opt/zeppelin/conf/
Edit zeppelin-env.sh
Uncomment export HADOOP_CONF_DIR
Set it to export HADOOP_CONF_DIR=“/etc/hadoop/conf”
Starting/Stopping Apache Zeppelin
Start Zeppelin
/opt/zeppelin/bin/zeppelin-daemon.sh start
Restart Zeppelin
/opt/zeppelin/bin/zeppelin-daemon.sh restart
Stop Zeppelin
/opt/zeppelin/bin/zeppelin-daemon.sh stop
Viewing Web UI
Once the zeppelin process is running you can view the WebUI by opening a web browser and navigating to:
http://{HOST}:8080/
Note: Network rules will need to allow this communication
Runtime Apache Zeppelin Configuration
Further configurations maybe needed for certain operations to work
Configure Hive in Zeppelin
Open the cloudera manager and get the public host name of the machine that has the HiveServer2 role. Identify this as HIVESERVER2_HOST
Open the Web UI and click the Interpreter tab
Change the Hive default.url option to: jdbc:hive2://{HIVESERVER2_HOST}:10000
How to check the MD5 checksum of a downloaded file
Issue:
You would like to verify the integrity of your downloaded files.
Solution:
WINDOWS:
Download the latest version of WinMD5Free.
Extract the downloaded zip and launch the WinMD5.exe file.
Click on the Browse button, navigate to the file that you want to check and select it.
Just as you select the file, the tool will show you its MD5 checksum.
Copy and paste the original MD5 value provided by the developer or the download page.
Click on Verify button.
MAC:
Download the file you want to check and open the download folder in Finder.
Open the Terminal, from the Applications / Utilities folder.
Type md5 followed by a space. Do not press Enter yet.
Drag the downloaded file from the Finder window into the Terminal window.
Press Enter and wait a few moments.
The MD5 hash of the file is displayed in the Terminal.
Open the checksum file provided on the Web page where you downloaded your file from.
The file usually has a .cksum extension.
NOTE: The file should contain the MD5 sum of the download file. For example: md5sum: 25d422cc23b44c3bbd7a66c76d52af46
Compare the MD5 hash in the checksum file to the one displayed in the Terminal.
If they are exactly the same, your file was downloaded successfully. Otherwise, download your file again.
LINUX:
Open a terminal window.
Type the following command: md5sum [type file name with extension here] [path of the file] -- NOTE: You can also drag the file to the terminal window instead of typing the full path.
Hit the Enter key.
You’ll see the MD5 sum of the file.
Match it against the original value.
Cannot Login to Cloudera Manager with LDAP/LDAPS Enabled
Summary
After changing ‘Authentication Backend Order’ to external, users cannot login. This guide explains how to revert back to default behaviour, authenticating through database first.
Symptoms
Users cannot login to Cloudera Manager
Conditions
Cloudera Manager boots up
Login page accessible through the browser
External authentication is enabled (LDAP, LDAP with TLS = LDAPS)
Authentication Backend Order, was changed to external authentication.
Cause
Cloudera Manager is trying to connect to LDAP If auth_backend_order is set to external only or external and DB. A misconfiguration with LDAP or External authentication is causing Cloudera Manager Server to unable to map users credential appropriately.
Instructions
Please follow the instructions to fix this.
Note: Take backup of the SCM database [0]
By deleting auth_backend_order order config Cloudera Manager falls back to the DB_ONLY auth backend and will not try to connect to the LDAP server.
Step 1:
Stop the Cloudera Manager server
$sudo service cloudera-scm-server stop
Confirm the auth_backend_order is other than non-default ie: not DB_ONLY or nothing.
Step – 2:
Run this query in the Cloudera Manager schema to reset the Authentication Backend Order configuration:
Connect mysql DB:
./mysql -u root -p
mysql>use scm;
mysql> select ATTR, VALUE from CONFIGS where ATTR = “auth_backend_order”;
Delete the auth_backend_order attribute from Cloudera Manager database (this will revert to default behavior). Run below query in the Cloudera Manager schema to reset the Authentication Backend Order configuration:
mysql> delete from CONFIGS where ATTR = “auth_backend_order” and SERVICE_ID is null;
Step – 3:
Start the Cloudera Manager server
$sudo service cloudera-scm-server start
Try to login now with admin user.
Reference
https://www.devopsbaba.com/cannot-login-to-cloudera-manager-with-ldap-ldaps-enabled/
Subscribe to:
Posts (Atom)