| HADOOP-11837 |
AuthenticationFilter should destroy SignerSecretProvider in Tomcat deployments |
Blocker |
security |
Venkat Ranganathan |
Bowen Zhang |
| HADOOP-11815 |
HttpServer2 should destroy SignerSecretProvider when it stops |
Blocker |
. |
Rohith Sharma K S |
Rohith Sharma K S |
| HADOOP-11787 |
OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit Mac |
Critical |
native |
Colin Patrick McCabe |
Kiran Kumar M R |
| HADOOP-11776 |
jdiff is broken in Hadoop 2 |
Blocker |
. |
Li Lu |
Li Lu |
| HADOOP-11761 |
Fix findbugs warnings in org.apache.hadoop.security.authentication |
Minor |
. |
Li Lu |
Li Lu |
| HADOOP-11757 |
NFS gateway should shutdown when it can't start UDP or TCP server |
Major |
nfs |
Brandon Li |
Brandon Li |
| HADOOP-11754 |
RM fails to start in non-secure mode due to authentication filter failure |
Blocker |
. |
Sangjin Lee |
Haohui Mai |
| HADOOP-11748 |
The secrets of auth cookies should not be specified in configuration in clear text |
Critical |
. |
Haohui Mai |
Li Lu |
| HADOOP-11738 |
Fix a link of Protocol Buffers 2.5 for download in BUILDING.txt |
Major |
. |
Tsuyoshi Ozawa |
Tsuyoshi Ozawa |
| HADOOP-11729 |
Fix link to cgroups doc in site.xml |
Minor |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
| HADOOP-11722 |
Some Instances of Services using ZKDelegationTokenSecretManager go down when old token cannot be deleted |
Major |
. |
Arun Suresh |
Arun Suresh |
| HADOOP-11720 |
[JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools |
Major |
documentation |
Akira AJISAKA |
Akira AJISAKA |
| HADOOP-11693 |
Azure Storage FileSystem rename operations are throttled too aggressively to complete HBase WAL archiving. |
Major |
tools |
Duo Xu |
Duo Xu |
| HADOOP-11691 |
X86 build of libwinutils is broken |
Critical |
build, native |
Remus Rusanu |
Kiran Kumar M R |
| HADOOP-11686 |
MiniKDC cannot change ORG_NAME or ORG_DOMAIN |
Major |
security, test |
Duo Zhang |
Duo Zhang |
| HADOOP-11674 |
oneByteBuf in CryptoInputStream and CryptoOutputStream should be non static |
Critical |
io |
Sean Busbey |
Sean Busbey |
| HADOOP-11666 |
Revert the format change of du output introduced by HADOOP-6857 |
Major |
. |
Akira AJISAKA |
Byron Wong |
| HADOOP-11639 |
Clean up Windows native code compilation warnings related to Windows Secure Container Executor. |
Major |
native |
Chris Nauroth |
Remus Rusanu |
| HADOOP-11638 |
OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux |
Major |
native |
Dmitry Sivachenko |
Kiran Kumar M R |
| HADOOP-11634 |
Description of webhdfs' principal/keytab should switch places each other |
Major |
documentation |
Brahma Reddy Battula |
Brahma Reddy Battula |
| HADOOP-11629 |
WASB filesystem should not start BandwidthGaugeUpdater if fs.azure.skip.metrics set to true |
Major |
tools |
shanyu zhao |
shanyu zhao |
| HADOOP-11619 |
FTPFileSystem should override getDefaultPort |
Major |
fs |
Gera Shegalov |
Brahma Reddy Battula |
| HADOOP-11618 |
DelegateToFileSystem erroneously uses default FS's port in constructor |
Major |
fs |
Gera Shegalov |
Brahma Reddy Battula |
| HADOOP-11615 |
Update ServiceLevelAuth.md for YARN |
Minor |
documentation |
Akira AJISAKA |
Brahma Reddy Battula |
| HADOOP-11609 |
Correct credential commands info in CommandsManual.html#credential |
Major |
documentation, security |
Brahma Reddy Battula |
Varun Saxena |
| HADOOP-11605 |
FilterFileSystem#create with ChecksumOpt should propagate it to wrapped FS |
Minor |
fs |
Gera Shegalov |
Gera Shegalov |
| HADOOP-11604 |
Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. |
Critical |
net |
Liang Xie |
Chris Nauroth |
| HADOOP-11602 |
Fix toUpperCase/toLowerCase to use Locale.ENGLISH |
Blocker |
. |
Tsuyoshi Ozawa |
Tsuyoshi Ozawa |
| HADOOP-11595 |
Add default implementation for AbstractFileSystem#truncate |
Major |
fs |
Yi Liu |
Yi Liu |
| HADOOP-11587 |
TestMapFile#testMainMethodMapFile creates test files in hadoop-common project root |
Trivial |
test |
Xiaoyu Yao |
Xiaoyu Yao |
| HADOOP-11571 |
Über-jira: S3a stabilisation phase I |
Blocker |
fs/s3 |
Steve Loughran |
Steve Loughran |
| HADOOP-11558 |
Fix dead links to doc of hadoop-tools |
Minor |
documentation |
Masatake Iwasaki |
Jean-Pierre Matsumoto |
| HADOOP-11549 |
flaky test detection tool failed to handle special control characters in test result |
Major |
tools |
Yongjun Zhang |
Yongjun Zhang |
| HADOOP-11548 |
checknative should display a nicer error message when openssl support is not compiled in |
Major |
build, native |
Colin Patrick McCabe |
Anu Engineer |
| HADOOP-11547 |
hadoop-common native compilation fails on Windows due to missing support for __attribute__ declaration. |
Major |
native |
Chris Nauroth |
Chris Nauroth |
| HADOOP-11546 |
Checkstyle failing: Unable to instantiate DoubleCheckedLockingCheck |
Major |
build |
Steve Loughran |
Tsuyoshi Ozawa |
| HADOOP-11545 |
ArrayIndexOutOfBoundsException is thrown with "hadoop credential list -provider" |
Minor |
security |
Brahma Reddy Battula |
Brahma Reddy Battula |
| HADOOP-11529 |
Fix findbugs warnings in hadoop-archives |
Minor |
tools |
Masatake Iwasaki |
Masatake Iwasaki |
| HADOOP-11526 |
Memory leak in Bzip2Compressor and Bzip2Decompressor |
Major |
io, native |
Ian Rogers |
Anu Engineer |
| HADOOP-11523 |
StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB |
Major |
tools |
Duo Xu |
Duo Xu |
| HADOOP-11512 |
Use getTrimmedStrings when reading serialization keys |
Minor |
io |
Harsh J |
Ryan P |
| HADOOP-11509 |
change parsing sequence in GenericOptionsParser to parse -D parameters first |
Major |
. |
Xuan Gong |
Xuan Gong |
| HADOOP-11507 |
Hadoop RPC Authentication problem with different user locale |
Minor |
. |
Talat UYARER |
Talat UYARER |
| HADOOP-11500 |
InputStream is left unclosed in ApplicationClassLoader |
Major |
. |
Ted Yu |
Ted Yu |
| HADOOP-11499 |
Check of executorThreadsStarted in ValueQueue#submitRefillTask() evades lock acquisition |
Minor |
. |
Ted Yu |
Ted Yu |
| HADOOP-11497 |
Fix typo in ClusterSetup.html#Hadoop_Startup |
Major |
documentation |
Christian Winkler |
Christian Winkler |
| HADOOP-11494 |
Lock acquisition on WrappedInputStream#unwrappedRpcBuffer may race with another thread |
Minor |
. |
Ted Yu |
Ted Yu |
| HADOOP-11493 |
Fix some typos in kms-acls.xml description |
Trivial |
kms |
Charles Lamb |
Charles Lamb |
| HADOOP-11488 |
Difference in default connection timeout for S3A FS |
Minor |
fs/s3 |
Harsh J |
Daisuke Kobayashi |
| HADOOP-11482 |
Use correct UGI when KMSClientProvider is called by a proxy user |
Major |
. |
Arun Suresh |
Arun Suresh |
| HADOOP-11480 |
Typo in hadoop-aws/index.md uses wrong scheme for test.fs.s3.name |
Minor |
documentation |
Ted Yu |
Ted Yu |
| HADOOP-11470 |
Remove some uses of obsolete guava APIs from the hadoop codebase |
Major |
. |
Sangjin Lee |
Sangjin Lee |
| HADOOP-11469 |
KMS should skip default.key.acl and whitelist.key.acl when loading key acl |
Minor |
kms |
Dian Fu |
Dian Fu |
| HADOOP-11467 |
KerberosAuthenticator can connect to a non-secure cluster |
Critical |
security |
Robert Kanter |
Yongjun Zhang |
| HADOOP-11462 |
TestSocketIOWithTimeout needs change for PowerPC platform |
Major |
test |
Ayappan |
Ayappan |
| HADOOP-11459 |
Fix recent findbugs in ActiveStandbyElector, NetUtils and ShellBasedIdMapping |
Minor |
. |
Vinayakumar B |
Vinayakumar B |
| HADOOP-11450 |
Cleanup DistCpV1 not to use deprecated methods and fix javadocs |
Minor |
tools/distcp |
Tsuyoshi Ozawa |
Varun Saxena |
| HADOOP-11449 |
[JDK8] Cannot build on Windows: error: unexpected end tag: </ul> |
Major |
build |
Alec Taylor |
Chris Nauroth |
| HADOOP-11446 |
S3AOutputStream should use shared thread pool to avoid OutOfMemoryError |
Major |
fs/s3 |
Ted Yu |
Ted Yu |
| HADOOP-11445 |
Bzip2Codec: Data block is skipped when position of newly created stream is equal to start of split |
Critical |
. |
Ankit Kamboj |
Ankit Kamboj |
| HADOOP-11431 |
clean up redundant maven-site-plugin configuration |
Major |
. |
Hervé Boutemy |
Hervé Boutemy |
| HADOOP-11428 |
Remove obsolete reference to Cygwin in BUILDING.txt |
Major |
documentation |
Arpit Agarwal |
Arpit Agarwal |
| HADOOP-11420 |
Use latest maven-site-plugin and replace link to svn with link to git |
Trivial |
site |
Hervé Boutemy |
Hervé Boutemy |
| HADOOP-11414 |
FileBasedIPList#readLines() can leak file descriptors |
Minor |
. |
Ted Yu |
Tsuyoshi Ozawa |
| HADOOP-11412 |
POMs mention "The Apache Software License" rather than "Apache License" |
Trivial |
. |
Hervé Boutemy |
Hervé Boutemy |
| HADOOP-11411 |
Hive build failure on hadoop-2.7 due to HADOOP-11356 |
Major |
. |
Jason Dere |
|
| HADOOP-11409 |
FileContext.getFileContext can stack overflow if default fs misconfigured |
Major |
. |
Jason Lowe |
Gera Shegalov |
| HADOOP-11403 |
Avoid using sys_errlist on Solaris, which lacks support for it |
Major |
. |
Malcolm Kavalsky |
Malcolm Kavalsky |
| HADOOP-11402 |
Negative user-to-group cache entries are never cleared for never-again-accessed users |
Major |
. |
Colin Patrick McCabe |
Varun Saxena |
| HADOOP-11400 |
GraphiteSink does not reconnect to Graphite after 'broken pipe' |
Major |
metrics |
Kamil Gorlo |
Kamil Gorlo |
| HADOOP-11394 |
hadoop-aws documentation missing. |
Major |
documentation |
Chris Nauroth |
Chris Nauroth |
| HADOOP-11388 |
Remove deprecated o.a.h.metrics.file.FileContext |
Minor |
. |
Haohui Mai |
Li Lu |
| HADOOP-11386 |
Replace by %n in format hadoop-common format strings |
Major |
. |
Li Lu |
Li Lu |
| HADOOP-11368 |
Fix SSLFactory truststore reloader thread leak in KMSClientProvider |
Major |
kms |
Arun Suresh |
Arun Suresh |
| HADOOP-11363 |
Hadoop maven surefire-plugin uses must set heap size |
Major |
build |
Steve Loughran |
Steve Loughran |
| HADOOP-11355 |
When accessing data in HDFS and the key has been deleted, a Null Pointer Exception is shown. |
Minor |
. |
Arun Suresh |
Arun Suresh |
| HADOOP-11354 |
ThrottledInputStream doesn't perform effective throttling |
Major |
. |
Ted Yu |
Ted Yu |
| HADOOP-11350 |
The size of header buffer of HttpServer is too small when HTTPS is enabled |
Major |
security |
Benoy Antony |
Benoy Antony |
| HADOOP-11349 |
RawLocalFileSystem leaks file descriptor while creating a file if creat succeeds but chmod fails. |
Minor |
fs |
Chris Nauroth |
Varun Saxena |
| HADOOP-11348 |
Remove unused variable from CMake error message for finding openssl |
Minor |
. |
Dian Fu |
Dian Fu |
| HADOOP-11344 |
KMS kms-config.sh sets a default value for the keystore password even in non-ssl setup |
Major |
. |
Arun Suresh |
Arun Suresh |
| HADOOP-11343 |
Overflow is not properly handled in caclulating final iv for AES CTR |
Blocker |
security |
Jerry Chen |
Jerry Chen |
| HADOOP-11342 |
KMS key ACL should ignore ALL operation for default key ACL and whitelist key ACL |
Major |
kms, security |
Dian Fu |
Dian Fu |
| HADOOP-11337 |
KeyAuthorizationKeyProvider access checks need to be done atomically |
Major |
. |
Dian Fu |
Dian Fu |
| HADOOP-11333 |
Fix deadlock in DomainSocketWatcher when the notification pipe is full |
Major |
. |
zhaoyunjiong |
zhaoyunjiong |
| HADOOP-11332 |
KerberosAuthenticator#doSpnegoSequence should check if kerberos TGT is available in the subject |
Major |
security |
Dian Fu |
Dian Fu |
| HADOOP-11329 |
Add JAVA_LIBRARY_PATH to KMS startup options |
Major |
kms, security |
Dian Fu |
Arun Suresh |
| HADOOP-11327 |
BloomFilter#not() omits the last bit, resulting in an incorrect filter |
Minor |
util |
Tim Luo |
Eric Payne |
| HADOOP-11322 |
key based ACL check in KMS always check KeyOpType.MANAGEMENT even actual KeyOpType is not MANAGEMENT |
Major |
security |
Dian Fu |
Dian Fu |
| HADOOP-11321 |
copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions. |
Major |
fs |
Chris Nauroth |
Chris Nauroth |
| HADOOP-11318 |
Update the document for hadoop fs -stat |
Major |
documentation |
Akira AJISAKA |
Akira AJISAKA |
| HADOOP-11316 |
"mvn package -Pdist,docs -DskipTests -Dtar" fails because of non-ascii characters |
Blocker |
. |
Tsuyoshi Ozawa |
Tsuyoshi Ozawa |
| HADOOP-11312 |
Fix unit tests to not use uppercase key names |
Major |
security |
Andrew Wang |
Andrew Wang |
| HADOOP-11309 |
System class pattern package.Foo should match package.Foo$Bar, too |
Blocker |
. |
Gera Shegalov |
Gera Shegalov |
| HADOOP-11300 |
KMS startup scripts must not display the keystore / truststore passwords |
Major |
kms |
Arun Suresh |
Arun Suresh |
| HADOOP-11295 |
RPC Server Reader thread can't shutdown if RPCCallQueue is full |
Major |
. |
Ming Ma |
Ming Ma |
| HADOOP-11294 |
Nfs3FileAttributes should not change the values of rdev, nlink and size in the constructor |
Minor |
nfs |
Brandon Li |
Brandon Li |
| HADOOP-11289 |
Fix typo in RpcUtil log message |
Trivial |
net |
Charles Lamb |
Charles Lamb |
| HADOOP-11287 |
Simplify UGI#reloginFromKeytab for Java 7+ |
Major |
. |
Haohui Mai |
Li Lu |
| HADOOP-11283 |
Potentially unclosed SequenceFile.Writer in DistCpV1#setup() |
Minor |
. |
Ted Yu |
Varun Saxena |
| HADOOP-11273 |
TestMiniKdc failure: login options not compatible with IBM JDK |
Major |
test |
Gao Zhong Liang |
Gao Zhong Liang |
| HADOOP-11272 |
Allow ZKSignerSecretProvider and ZKDelegationTokenSecretManager to use the same curator client |
Major |
. |
Arun Suresh |
Arun Suresh |
| HADOOP-11271 |
Use Time.monotonicNow() in Shell.java instead of Time.now() |
Minor |
. |
Vinayakumar B |
Vinayakumar B |
| HADOOP-11269 |
Add java 8 profile for hadoop-annotations |
Major |
. |
Haohui Mai |
Li Lu |
| HADOOP-11268 |
Update BUILDING.txt to remove the workaround for tools.jar |
Minor |
. |
Haohui Mai |
Li Lu |
| HADOOP-11267 |
TestSecurityUtil fails when run with JDK8 because of empty principal names |
Minor |
security, test |
Stephen Chu |
Stephen Chu |
| HADOOP-11266 |
Remove no longer supported activation properties for packaging from pom |
Trivial |
build |
Masatake Iwasaki |
Masatake Iwasaki |
| HADOOP-11256 |
Some site docs have inconsistent appearance |
Minor |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
| HADOOP-11248 |
Add hadoop configuration to disable Azure Filesystem metrics collection |
Major |
fs |
shanyu zhao |
shanyu zhao |
| HADOOP-11246 |
Move jenkins to Java 7 |
Major |
. |
Haohui Mai |
Steve Loughran |
| HADOOP-11238 |
Update the NameNode's Group Cache in the background when possible |
Minor |
. |
Chris Li |
Chris Li |
| HADOOP-11236 |
NFS: Fix javadoc warning in RpcProgram.java |
Trivial |
documentation |
Abhiraj Butala |
Abhiraj Butala |
| HADOOP-11230 |
Add missing dependency of bouncycastle for kms, httpfs, hdfs, MR and YARN |
Major |
test |
Robert Kanter |
Robert Kanter |
| HADOOP-11213 |
Typos in html pages: SecureMode and EncryptedShuffle |
Minor |
. |
Wei Yan |
Wei Yan |
| HADOOP-11211 |
mapreduce.job.classloader.system.classes semantics should be order-independent |
Major |
. |
Yitong Zhou |
Yitong Zhou |
| HADOOP-11209 |
Configuration#updatingResource/finalParameters are not thread-safe |
Major |
conf |
Josh Rosen |
Varun Saxena |
| HADOOP-11201 |
Hadoop Archives should support globs resolving to files |
Blocker |
tools |
Gera Shegalov |
Gera Shegalov |
| HADOOP-11187 |
NameNode - KMS communication fails after a long period of inactivity |
Major |
. |
Arun Suresh |
Arun Suresh |
| HADOOP-11186 |
documentation should talk about hadoop.htrace.spanreceiver.classes, not hadoop.trace.spanreceiver.classes |
Minor |
. |
Colin Patrick McCabe |
Colin Patrick McCabe |
| HADOOP-11166 |
Remove ulimit from test-patch.sh |
Major |
. |
Andrew Wang |
Andrew Wang |
| HADOOP-11157 |
ZKDelegationTokenSecretManager never shuts down listenerThreadPool |
Major |
security |
Gregory Chanan |
Arun Suresh |
| HADOOP-11156 |
DelegateToFileSystem should implement getFsStatus(final Path f). |
Major |
fs |
zhihai xu |
zhihai xu |
| HADOOP-11039 |
ByteBufferReadable API doc is inconsistent with the implementations. |
Minor |
documentation |
Yi Liu |
Yi Liu |
| HADOOP-11014 |
Potential resource leak in JavaKeyStoreProvider due to unclosed stream |
Minor |
security |
Ted Yu |
Tsuyoshi Ozawa |
| HADOOP-11008 |
Remove duplicated description about proxy-user in site documents |
Minor |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
| HADOOP-11000 |
HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING |
Major |
. |
Ming Ma |
Ming Ma |
| HADOOP-10953 |
NetworkTopology#add calls NetworkTopology#toString without holding the netlock |
Minor |
net |
Liang Xie |
Liang Xie |
| HADOOP-10852 |
NetgroupCache is not thread-safe |
Major |
security |
Benoy Antony |
Benoy Antony |
| HADOOP-10840 |
Fix OutOfMemoryError caused by metrics system in Azure File System |
Major |
metrics |
shanyu zhao |
shanyu zhao |
| HADOOP-10786 |
Fix UGI#reloginFromKeytab on Java 8 |
Major |
security |
Tobi Vollebregt |
Stephen Chu |
| HADOOP-10748 |
HttpServer2 should not load JspServlet |
Major |
. |
Haohui Mai |
Haohui Mai |
| HADOOP-10717 |
HttpServer2 should load jsp DTD from local jars instead of going remote |
Blocker |
. |
Dapeng Sun |
Dapeng Sun |
| HADOOP-10714 |
AmazonS3Client.deleteObjects() need to be limited to 1000 entries per call |
Critical |
fs/s3 |
David S. Wang |
Juan Yu |
| HADOOP-10703 |
HttpServer2 creates multiple authentication filters |
Major |
security |
Benoy Antony |
Benoy Antony |
| HADOOP-10690 |
Lack of synchronization on access to InputStream in NativeAzureFileSystem#NativeAzureFsInputStream#close() |
Minor |
tools |
Ted Yu |
Chen He |
| HADOOP-10689 |
InputStream is not closed in AzureNativeFileSystemStore#retrieve() |
Minor |
tools |
Ted Yu |
Chen He |
| HADOOP-10542 |
Potential null pointer dereference in Jets3tFileSystemStore#retrieveBlock() |
Minor |
fs/s3 |
Ted Yu |
Ted Yu |
| HADOOP-10181 |
GangliaContext does not work with multicast ganglia setup |
Minor |
metrics |
Andrew Otto |
Andrew Johnson |
| HADOOP-10134 |
[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments |
Minor |
. |
Andrew Purtell |
Andrew Purtell |
| HADOOP-10062 |
race condition in MetricsSystemImpl#publishMetricsNow that causes incorrect results |
Major |
metrics |
Shinichi Yamashita |
Sangjin Lee |
| HADOOP-9922 |
hadoop windows native build will fail in 32 bit machine |
Major |
build, native |
Vinayakumar B |
Kiran Kumar M R |
| HADOOP-9907 |
Webapp http://hostname:port/metrics link is not working |
Critical |
. |
Jian He |
Akira AJISAKA |
| HADOOP-9137 |
Support connection limiting in IPC server |
Major |
. |
Sanjay Radia |
Kihwal Lee |
| HADOOP-9087 |
Queue size metric for metric sinks isn't actually maintained |
Minor |
metrics |
Mostafa Elhemali |
Akira AJISAKA |
| HADOOP-8642 |
Document that io.native.lib.available only controls native bz2 and zlib compression codecs |
Major |
documentation, native |
Eli Collins |
Akira AJISAKA |
| HADOOP-6221 |
RPC Client operations cannot be interrupted |
Minor |
ipc |
Steve Loughran |
Steve Loughran |
| HDFS-8072 |
Reserved RBW space is not released if client terminates while writing block |
Major |
datanode |
Arpit Agarwal |
Arpit Agarwal |
| HDFS-8063 |
Fix intermittent test failures in TestTracing |
Minor |
test |
Masatake Iwasaki |
Masatake Iwasaki |
| HDFS-8051 |
FsVolumeList#addVolume should release volume reference if not put it into BlockScanner. |
Major |
datanode |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
| HDFS-8036 |
Use snapshot path as source when using snapshot diff report in DistCp |
Major |
distcp |
Sushmitha Sreenivasan |
Jing Zhao |
| HDFS-8025 |
Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replicated |
Major |
. |
Ming Ma |
Ming Ma |
| HDFS-8001 |
RpcProgramNfs3 : wrong parsing of dfs.blocksize |
Trivial |
nfs |
Remi Catherinot |
Remi Catherinot |
| HDFS-7999 |
FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time |
Major |
. |
zhouyingchao |
zhouyingchao |
| HDFS-7996 |
After swapping a volume, BlockReceiver reports ReplicaNotFoundException |
Critical |
datanode |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
| HDFS-7977 |
NFS couldn't take percentile intervals |
Major |
nfs |
Brandon Li |
Brandon Li |
| HDFS-7963 |
Fix expected tracing spans in TestTracing along with HDFS-7054 |
Critical |
test |
Masatake Iwasaki |
Masatake Iwasaki |
| HDFS-7961 |
Trigger full block report after hot swapping disk |
Major |
. |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
| HDFS-7960 |
The full block report should prune zombie storages even if they're not empty |
Critical |
. |
Lei (Eddy) Xu |
Colin Patrick McCabe |
| HDFS-7957 |
Truncate should verify quota before making changes |
Critical |
namenode |
Jing Zhao |
Jing Zhao |
| HDFS-7956 |
Improve logging for DatanodeRegistration. |
Major |
namenode |
Konstantin Shvachko |
Plamen Jeliazkov |
| HDFS-7953 |
NN Web UI fails to navigate to paths that contain # |
Minor |
namenode |
Kanaka Kumar Avvaru |
Kanaka Kumar Avvaru |
| HDFS-7945 |
The WebHdfs system on DN does not honor the length parameter |
Blocker |
. |
Haohui Mai |
Haohui Mai |
| HDFS-7943 |
Append cannot handle the last block with length greater than the preferred block size |
Blocker |
. |
Jing Zhao |
Jing Zhao |
| HDFS-7942 |
NFS: support regexp grouping in nfs.exports.allowed.hosts |
Major |
nfs |
Brandon Li |
Brandon Li |
| HDFS-7932 |
Speed up the shutdown of datanode during rolling upgrade |
Major |
. |
Kihwal Lee |
Kihwal Lee |
| HDFS-7930 |
commitBlockSynchronization() does not remove locations |
Blocker |
namenode |
Konstantin Shvachko |
Yi Liu |
| HDFS-7929 |
inotify unable fetch pre-upgrade edit log segments once upgrade starts |
Major |
. |
Zhe Zhang |
Zhe Zhang |
| HDFS-7926 |
NameNode implementation of ClientProtocol.truncate(..) is not idempotent |
Major |
namenode |
Tsz Wo Nicholas Sze |
Tsz Wo Nicholas Sze |
| HDFS-7915 |
The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error |
Major |
. |
Colin Patrick McCabe |
Colin Patrick McCabe |
| HDFS-7886 |
TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes |
Minor |
test |
Yi Liu |
Plamen Jeliazkov |
| HDFS-7885 |
Datanode should not trust the generation stamp provided by client |
Critical |
datanode |
vitthal (Suhas) Gogate |
Tsz Wo Nicholas Sze |
| HDFS-7884 |
NullPointerException in BlockSender |
Blocker |
datanode |
Tsz Wo Nicholas Sze |
Brahma Reddy Battula |
| HDFS-7881 |
TestHftpFileSystem#testSeek fails in branch-2 |
Blocker |
. |
Akira AJISAKA |
Brahma Reddy Battula |
| HDFS-7880 |
Remove the tests for legacy Web UI in branch-2 |
Blocker |
test |
Akira AJISAKA |
Brahma Reddy Battula |
| HDFS-7879 |
hdfs.dll does not export functions of the public libhdfs API |
Major |
build, libhdfs |
Chris Nauroth |
Chris Nauroth |
| HDFS-7871 |
NameNodeEditLogRoller can keep printing "Swallowing exception" message |
Critical |
. |
Jing Zhao |
Jing Zhao |
| HDFS-7869 |
Inconsistency in the return information while performing rolling upgrade |
Major |
. |
J.Andreina |
J.Andreina |
| HDFS-7831 |
Fix the starting index and end condition of the loop in FileDiffList.findEarlierSnapshotBlocks() |
Major |
. |
Konstantin Shvachko |
Konstantin Shvachko |
| HDFS-7830 |
DataNode does not release the volume lock when adding a volume fails. |
Major |
datanode |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
| HDFS-7818 |
OffsetParam should return the default value instead of throwing NPE when the value is unspecified |
Blocker |
webhdfs |
Eric Payne |
Eric Payne |
| HDFS-7816 |
Unable to open webhdfs paths with "+" |
Blocker |
webhdfs |
Jason Lowe |
Haohui Mai |
| HDFS-7813 |
TestDFSHAAdminMiniCluster#testFencer testcase is failing frequently |
Major |
ha, test |
Rakesh R |
Rakesh R |
| HDFS-7807 |
libhdfs htable.c: fix htable resizing, add unit test |
Major |
native |
Colin Patrick McCabe |
Colin Patrick McCabe |
| HDFS-7805 |
NameNode recovery prompt should be printed on console |
Major |
namenode |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
| HDFS-7798 |
Checkpointing failure caused by shared KerberosAuthenticator |
Critical |
security |
Chengbing Liu |
Chengbing Liu |
| HDFS-7788 |
Post-2.6 namenode may not start up with an image containing inodes created with an old release. |
Blocker |
. |
Kihwal Lee |
Rushabh S Shah |
| HDFS-7785 |
Improve diagnostics information for HttpPutFailedException |
Major |
namenode |
Chengbing Liu |
Chengbing Liu |
| HDFS-7778 |
Rename FsVolumeListTest to TestFsVolumeList and commit it to branch-2 |
Major |
datanode, test |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
| HDFS-7774 |
Unresolved symbols error while compiling HDFS on Windows 7/32 bit |
Critical |
build, native |
Venkatasubramaniam Ramakrishnan |
Kiran Kumar M R |
| HDFS-7769 |
TestHDFSCLI create files in hdfs project root dir |
Trivial |
test |
Tsz Wo Nicholas Sze |
|
| HDFS-7763 |
fix zkfc hung issue due to not catching exception in a corner case |
Major |
ha |
Liang Xie |
Liang Xie |
| HDFS-7756 |
Restore method signature for LocatedBlock#getLocations() |
Major |
. |
Ted Yu |
Ted Yu |
| HDFS-7753 |
Fix Multithreaded correctness Warnings in BackupImage.java |
Major |
. |
Rakesh R |
Konstantin Shvachko |
| HDFS-7748 |
Separate ECN flags from the Status in the DataTransferPipelineAck |
Blocker |
. |
Haohui Mai |
Anu Engineer |
| HDFS-7744 |
Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called |
Major |
hdfs-client |
Colin Patrick McCabe |
Colin Patrick McCabe |
| HDFS-7742 |
favoring decommissioning node for replication can cause a block to stay underreplicated for long periods |
Major |
namenode |
Nathan Roberts |
Nathan Roberts |
| HDFS-7741 |
Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream |
Minor |
. |
Yi Liu |
Yi Liu |
| HDFS-7734 |
Class cast exception in NameNode#main |
Blocker |
namenode |
Arpit Agarwal |
Yi Liu |
| HDFS-7722 |
DataNode#checkDiskError should also remove Storage when error is found. |
Major |
datanode |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
| HDFS-7721 |
The HDFS BlockScanner may run fast during the first hour |
Major |
datanode |
Tsz Wo Nicholas Sze |
Colin Patrick McCabe |
| HDFS-7719 |
BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes |
Major |
. |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
| HDFS-7718 |
Store KeyProvider in ClientContext to avoid leaking key provider threads when using FileContext |
Major |
. |
Arun Suresh |
Arun Suresh |
| HDFS-7714 |
Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode. |
Major |
datanode |
Chris Nauroth |
Vinayakumar B |
| HDFS-7709 |
Fix findbug warnings in httpfs |
Major |
. |
Rakesh R |
Rakesh R |
| HDFS-7707 |
Edit log corruption due to delayed block removal again |
Major |
namenode |
Yongjun Zhang |
Yongjun Zhang |
| HDFS-7704 |
DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out. |
Major |
datanode, namenode |
Rushabh S Shah |
Rushabh S Shah |
| HDFS-7698 |
Fix locking on HDFS read statistics and add a method for clearing them. |
Major |
. |
Colin Patrick McCabe |
Colin Patrick McCabe |
| HDFS-7697 |
Mark the PB OIV tool as experimental |
Major |
. |
Haohui Mai |
Lei (Eddy) Xu |
| HDFS-7696 |
FsDatasetImpl.getTmpInputStreams(..) may leak file descriptors |
Minor |
datanode |
Tsz Wo Nicholas Sze |
Tsz Wo Nicholas Sze |
| HDFS-7686 |
Re-add rapid rescan of possibly corrupt block feature to the block scanner |
Blocker |
. |
Rushabh S Shah |
Colin Patrick McCabe |
| HDFS-7682 |
{{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content |
Major |
. |
Charles Lamb |
Charles Lamb |
| HDFS-7660 |
BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly. |
Minor |
. |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
| HDFS-7647 |
DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs |
Major |
. |
Milan Desai |
Milan Desai |
| HDFS-7644 |
minor typo in HttpFS doc |
Trivial |
documentation |
Charles Lamb |
Charles Lamb |
| HDFS-7641 |
Update archival storage user doc for list/set/get block storage policies |
Minor |
documentation |
Yi Liu |
Yi Liu |
| HDFS-7637 |
Fix the check condition for reserved path |
Minor |
. |
Yi Liu |
Yi Liu |
| HDFS-7635 |
Remove TestCorruptFilesJsp from branch-2. |
Minor |
test |
Chris Nauroth |
Chris Nauroth |
| HDFS-7632 |
MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode. |
Major |
test |
Chris Nauroth |
Chris Nauroth |
| HDFS-7615 |
Remove longReadLock |
Major |
. |
Kihwal Lee |
Kihwal Lee |
| HDFS-7611 |
deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart. |
Critical |
namenode |
Konstantin Shvachko |
Jing Zhao |
| HDFS-7610 |
Fix removal of dynamically added DN volumes |
Major |
datanode |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
| HDFS-7606 |
Missing null check in INodeFile#getBlocks() |
Minor |
. |
Ted Yu |
Byron Wong |
| HDFS-7603 |
The background replication queue initialization may not let others run |
Critical |
rolling upgrades |
Kihwal Lee |
Kihwal Lee |
| HDFS-7596 |
NameNode should prune dead storages from storageMap |
Major |
namenode |
Arpit Agarwal |
Arpit Agarwal |
| HDFS-7587 |
Edit log corruption can happen if append fails with a quota violation |
Blocker |
namenode |
Kihwal Lee |
Jing Zhao |
| HDFS-7583 |
Fix findbug in TransferFsImage.java |
Minor |
namenode |
Vinayakumar B |
Vinayakumar B |
| HDFS-7575 |
Upgrade should generate a unique storage ID for each volume |
Critical |
. |
Lars Francke |
Arpit Agarwal |
| HDFS-7572 |
TestLazyPersistFiles#testDnRestartWithSavedReplicas is flaky on Windows |
Major |
test |
Arpit Agarwal |
Arpit Agarwal |
| HDFS-7566 |
Remove obsolete entries from hdfs-default.xml |
Major |
. |
Ray Chiang |
Ray Chiang |
| HDFS-7563 |
NFS gateway parseStaticMap NumberFormatException |
Major |
nfs |
Hari Sekhon |
Yongjun Zhang |
| HDFS-7561 |
TestFetchImage should write fetched-image-dir under target. |
Major |
. |
Konstantin Shvachko |
Liang Xie |
| HDFS-7560 |
ACLs removed by removeDefaultAcl() will be back after NameNode restart/failover |
Critical |
namenode |
Vinayakumar B |
Vinayakumar B |
| HDFS-7552 |
change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration |
Major |
datanode, test |
Liang Xie |
Liang Xie |
| HDFS-7548 |
Corrupt block reporting delayed until datablock scanner thread detects it |
Major |
. |
Rushabh S Shah |
Rushabh S Shah |
| HDFS-7536 |
Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs |
Minor |
security |
Yi Liu |
Yi Liu |
| HDFS-7533 |
Datanode sometimes does not shutdown on receiving upgrade shutdown command |
Major |
. |
Kihwal Lee |
Eric Payne |
| HDFS-7530 |
Allow renaming of encryption zone roots |
Minor |
namenode |
Charles Lamb |
Charles Lamb |
| HDFS-7517 |
Remove redundant non-null checks in FSNamesystem#getBlockLocations |
Major |
. |
Haohui Mai |
Haohui Mai |
| HDFS-7516 |
Fix findbugs warnings in hadoop-nfs project |
Major |
nfs |
Brandon Li |
Brandon Li |
| HDFS-7515 |
Fix new findbugs warnings in hadoop-hdfs |
Major |
. |
Haohui Mai |
Haohui Mai |
| HDFS-7514 |
TestTextCommand fails on Windows |
Major |
test |
Arpit Agarwal |
Arpit Agarwal |
| HDFS-7502 |
Fix findbugs warning in hdfs-nfs project |
Major |
nfs |
Brandon Li |
Brandon Li |
| HDFS-7497 |
Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui |
Major |
datanode, namenode |
Yongjun Zhang |
Yongjun Zhang |
| HDFS-7496 |
Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances |
Major |
. |
Colin Patrick McCabe |
Lei (Eddy) Xu |
| HDFS-7495 |
Remove updatePosition argument from DFSInputStream#getBlockAt() |
Minor |
. |
Ted Yu |
Colin Patrick McCabe |
| HDFS-7494 |
Checking of closed in DFSInputStream#pread() should be protected by synchronization |
Minor |
. |
Ted Yu |
Ted Yu |
| HDFS-7490 |
HDFS tests OOM on Java7+ |
Major |
build, test |
Steve Loughran |
Steve Loughran |
| HDFS-7481 |
Add ACL indicator to the "Permission Denied" exception. |
Minor |
namenode |
Vinayakumar B |
Vinayakumar B |
| HDFS-7473 |
Document setting dfs.namenode.fs-limits.max-directory-items to 0 is invalid |
Major |
documentation |
Jason Keller |
Akira AJISAKA |
| HDFS-7472 |
Fix typo in message of ReplicaNotFoundException |
Trivial |
. |
Masatake Iwasaki |
Masatake Iwasaki |
| HDFS-7470 |
SecondaryNameNode need twice memory when calling reloadFromImageFile |
Major |
namenode |
zhaoyunjiong |
zhaoyunjiong |
| HDFS-7457 |
DatanodeID generates excessive garbage |
Major |
namenode |
Daryn Sharp |
Daryn Sharp |
| HDFS-7456 |
De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode |
Major |
namenode |
Vinayakumar B |
Vinayakumar B |
| HDFS-7444 |
convertToBlockUnderConstruction should preserve BlockCollection |
Major |
. |
Haohui Mai |
Haohui Mai |
| HDFS-7431 |
log message for InvalidMagicNumberException may be incorrect |
Major |
security |
Yi Liu |
Yi Liu |
| HDFS-7423 |
various typos and message formatting fixes in nfs daemon and doc |
Trivial |
nfs |
Charles Lamb |
Charles Lamb |
| HDFS-7406 |
SimpleHttpProxyHandler puts incorrect "Connection: Close" header |
Major |
. |
Haohui Mai |
Haohui Mai |
| HDFS-7403 |
Inaccurate javadoc of BlockUCState#COMPLETE state |
Trivial |
namenode |
Yongjun Zhang |
Yongjun Zhang |
| HDFS-7399 |
Lack of synchronization in DFSOutputStream#Packet#getLastByteOffsetBlock() |
Minor |
. |
Ted Yu |
Vinayakumar B |
| HDFS-7395 |
BlockIdManager#clear() bails out when resetting the GenerationStampV1Limit |
Major |
namenode |
Yongjun Zhang |
Haohui Mai |
| HDFS-7394 |
Log at INFO level, not WARN level, when InvalidToken is seen in ShortCircuitCache |
Minor |
. |
Kihwal Lee |
Keith Pak |
| HDFS-7389 |
Named user ACL cannot stop the user from accessing the FS entity. |
Major |
namenode |
Chunjun Xiao |
Vinayakumar B |
| HDFS-7374 |
Allow decommissioning of dead DataNodes |
Major |
. |
Zhe Zhang |
Zhe Zhang |
| HDFS-7373 |
Clean up temporary files after fsimage transfer failures |
Major |
. |
Kihwal Lee |
Kihwal Lee |
| HDFS-7366 |
BlockInfo should take replication as an short in the constructor |
Minor |
. |
Haohui Mai |
Li Lu |
| HDFS-7361 |
TestCheckpoint#testStorageAlreadyLockedErrorMessage fails after change of log message related to locking violation. |
Minor |
datanode, namenode, test |
Chris Nauroth |
Konstantin Shvachko |
| HDFS-7358 |
Clients may get stuck waiting when using ByteArrayManager |
Major |
hdfs-client |
Tsz Wo Nicholas Sze |
Tsz Wo Nicholas Sze |
| HDFS-7315 |
DFSTestUtil.readFileBuffer opens extra FSDataInputStream |
Trivial |
. |
Plamen Jeliazkov |
Plamen Jeliazkov |
| HDFS-7303 |
NN UI fails to distinguish datanodes on the same host |
Minor |
. |
Benoy Antony |
Benoy Antony |
| HDFS-7301 |
TestMissingBlocksAlert should use MXBeans instead of old web UI |
Minor |
. |
Zhe Zhang |
Zhe Zhang |
| HDFS-7282 |
Fix intermittent TestShortCircuitCache and TestBlockReaderFactory failures resulting from TemporarySocketDirectory GC |
Major |
test |
Jinghui Wang |
Jinghui Wang |
| HDFS-7277 |
Remove explicit dependency on netty 3.2 in BKJournal |
Minor |
build |
Haohui Mai |
Haohui Mai |
| HDFS-7263 |
Snapshot read can reveal future bytes for appended files. |
Major |
hdfs-client |
Konstantin Shvachko |
Tao Luo |
| HDFS-7258 |
CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level |
Minor |
namenode |
Xiaoyu Yao |
Xiaoyu Yao |
| HDFS-7235 |
DataNode#transferBlock should report blocks that don't exist using reportBadBlock |
Major |
datanode, namenode |
Yongjun Zhang |
Yongjun Zhang |
| HDFS-7232 |
Populate hostname in httpfs audit log |
Trivial |
. |
Zoran Dimitrijevic |
Zoran Dimitrijevic |
| HDFS-7227 |
Fix findbugs warning about NP_DEREFERENCE_OF_READLINE_VALUE in SpanReceiverHost |
Minor |
. |
Colin Patrick McCabe |
Colin Patrick McCabe |
| HDFS-7225 |
Remove stale block invalidation work when DN re-registers with different UUID |
Major |
namenode |
Zhe Zhang |
Zhe Zhang |
| HDFS-7224 |
Allow reuse of NN connections via webhdfs |
Major |
webhdfs |
Eric Payne |
Eric Payne |
| HDFS-7213 |
processIncrementalBlockReport performance degradation |
Critical |
namenode |
Daryn Sharp |
Eric Payne |
| HDFS-7202 |
Should be able to omit package name of SpanReceiver on "hadoop trace -add" |
Minor |
. |
Masatake Iwasaki |
Masatake Iwasaki |
| HDFS-7201 |
Fix typos in hdfs-default.xml |
Major |
. |
Konstantin Shvachko |
Dawson Choong |
| HDFS-7198 |
Fix findbugs "unchecked conversion" warning in DFSClient#getPathTraceScope |
Trivial |
. |
Colin Patrick McCabe |
Colin Patrick McCabe |
| HDFS-7194 |
Fix findbugs "inefficient new String constructor" warning in DFSClient#PATH |
Trivial |
. |
Yongjun Zhang |
Yongjun Zhang |
| HDFS-7146 |
NFS ID/Group lookup requires SSSD enumeration on the server |
Major |
nfs |
Yongjun Zhang |
Yongjun Zhang |
| HDFS-7097 |
Allow block reports to be processed during checkpointing on standby name node |
Critical |
. |
Kihwal Lee |
Kihwal Lee |
| HDFS-7009 |
Active NN and standby NN have different live nodes |
Major |
datanode |
Ming Ma |
Ming Ma |
| HDFS-7008 |
xlator should be closed upon exit from DFSAdmin#genericRefresh() |
Minor |
. |
Ted Yu |
Tsuyoshi Ozawa |
| HDFS-6938 |
Cleanup javac warnings in FSNamesystem |
Trivial |
namenode |
Charles Lamb |
Charles Lamb |
| HDFS-6917 |
Add an hdfs debug command to validate blocks, call recoverlease, etc. |
Major |
hdfs-client |
Colin Patrick McCabe |
Colin Patrick McCabe |
| HDFS-6841 |
Use Time.monotonicNow() wherever applicable instead of Time.now() |
Major |
. |
Vinayakumar B |
Vinayakumar B |
| HDFS-6833 |
DirectoryScanner should not register a deleting block with memory of DataNode |
Critical |
datanode |
Shinichi Yamashita |
Shinichi Yamashita |
| HDFS-6753 |
Initialize checkDisk when DirectoryScanner not able to get files list for scanning |
Major |
. |
J.Andreina |
J.Andreina |
| HDFS-6672 |
Regression with hdfs oiv tool |
Minor |
. |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
| HDFS-6662 |
WebHDFS cannot open a file if its path contains "%" |
Critical |
namenode |
Brahma Reddy Battula |
Gerson Carlos |
| HDFS-6657 |
Remove link to 'Legacy UI' in Namenode UI |
Minor |
. |
Vinayakumar B |
Vinayakumar B |
| HDFS-6538 |
Comment format error in ShortCircuitRegistry javadoc |
Trivial |
datanode |
debugging |
David Luo |
| HDFS-6425 |
Large postponedMisreplicatedBlocks has impact on blockReport latency |
Major |
. |
Ming Ma |
Ming Ma |
| HDFS-5578 |
[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments |
Minor |
. |
Andrew Purtell |
Andrew Purtell |
| HDFS-5445 |
PacketReceiver populates the packetLen field in PacketHeader incorrectly |
Minor |
datanode |
Jonathan Mace |
Jonathan Mace |
| HDFS-3519 |
Checkpoint upload may interfere with a concurrent saveNamespace |
Critical |
namenode |
Todd Lipcon |
Ming Ma |
| HDFS-2605 |
CHANGES.txt has two "Release 0.21.1" sections |
Major |
documentation |
Konstantin Shvachko |
Allen Wittenauer |
| HDFS-1522 |
Merge Block.BLOCK_FILE_PREFIX and DataStorage.BLOCK_FILE_PREFIX into one constant |
Major |
datanode |
Konstantin Shvachko |
Dongming Liang |
| HDFS-49 |
MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found |
Minor |
test |
Steve Loughran |
Steve Loughran |
| MAPREDUCE-6303 |
Read timeout when retrying a fetch error can be fatal to a reducer |
Blocker |
. |
Jason Lowe |
Jason Lowe |
| MAPREDUCE-6285 |
ClientServiceDelegate should not retry upon AuthenticationException |
Major |
. |
Jonathan Eagles |
Jonathan Eagles |
| MAPREDUCE-6277 |
Job can post multiple history files if attempt loses connection to the RM |
Major |
mr-am |
Chang Li |
Chang Li |
| MAPREDUCE-6275 |
Race condition in FileOutputCommitter v2 for user-specified task output subdirs |
Critical |
. |
Siqi Li |
Gera Shegalov |
| MAPREDUCE-6268 |
Fix typo in Task Attempt API's URL |
Minor |
. |
Ryu Kobayashi |
Ryu Kobayashi |
| MAPREDUCE-6263 |
Configurable timeout between YARNRunner terminate the application and forcefully kill. |
Major |
client |
Jason Lowe |
Eric Payne |
| MAPREDUCE-6261 |
NullPointerException if MapOutputBuffer.flush invoked twice |
Major |
mrv2 |
Jason Lowe |
Tsuyoshi Ozawa |
| MAPREDUCE-6243 |
Fix findbugs warnings in hadoop-rumen |
Minor |
tools/rumen |
Akira AJISAKA |
Masatake Iwasaki |
| MAPREDUCE-6233 |
org.apache.hadoop.mapreduce.TestLargeSort.testLargeSort failed in trunk |
Major |
test |
Yongjun Zhang |
zhihai xu |
| MAPREDUCE-6231 |
Grep example job is not working on a fully-distributed cluster |
Major |
examples |
Akira AJISAKA |
Akira AJISAKA |
| MAPREDUCE-6230 |
MR AM does not survive RM restart if RM activated a new AMRM secret key |
Blocker |
mr-am |
Jason Lowe |
Jason Lowe |
| MAPREDUCE-6225 |
Fix new findbug warnings in hadoop-mapreduce-client-core |
Major |
. |
Jason Lowe |
Varun Saxena |
| MAPREDUCE-6221 |
Stringifier is left unclosed in Chain#getChainElementConf() |
Minor |
. |
Ted Yu |
Ted Yu |
| MAPREDUCE-6210 |
Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.java |
Minor |
applicationmaster |
Leitao Guo |
Leitao Guo |
| MAPREDUCE-6206 |
TestAggregatedTransferRate fails on non-US systems |
Critical |
. |
Jens Rabe |
Jens Rabe |
| MAPREDUCE-6186 |
Redundant call to requireJob() while displaying the conf page |
Minor |
jobhistoryserver |
Rohit Agarwal |
Rohit Agarwal |
| MAPREDUCE-6177 |
Minor typo in the EncryptedShuffle document about ssl-client.xml |
Trivial |
documentation |
yangping wu |
yangping wu |
| MAPREDUCE-6172 |
TestDbClasses timeouts are too aggressive |
Minor |
test |
Jason Lowe |
Varun Saxena |
| MAPREDUCE-6166 |
Reducers do not validate checksum of map outputs when fetching directly to disk |
Major |
mrv2 |
Eric Payne |
Eric Payne |
| MAPREDUCE-6162 |
mapred hsadmin fails on a secure cluster |
Blocker |
jobhistoryserver |
Jason Lowe |
Jason Lowe |
| MAPREDUCE-6160 |
Potential NullPointerException in MRClientProtocol interface implementation. |
Major |
. |
Rohith Sharma K S |
Rohith Sharma K S |
| MAPREDUCE-6136 |
MRAppMaster doesn't shutdown file systems |
Major |
applicationmaster |
Noah Watkins |
Brahma Reddy Battula |
| MAPREDUCE-6049 |
AM JVM does not exit if MRClientService gracefull shutdown fails |
Major |
applicationmaster, resourcemanager |
Nishan Shetty |
Rohith Sharma K S |
| MAPREDUCE-6045 |
need close the DataInputStream after open it in TestMapReduce.java |
Minor |
test |
zhihai xu |
zhihai xu |
| MAPREDUCE-5988 |
Fix dead links to the javadocs in mapreduce project |
Minor |
documentation |
Akira AJISAKA |
Akira AJISAKA |
| MAPREDUCE-5918 |
LineRecordReader can return the same decompressor to CodecPool multiple times |
Major |
. |
Sergey Murylev |
Sergey Murylev |
| MAPREDUCE-5657 |
[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments |
Minor |
documentation |
Andrew Purtell |
Akira AJISAKA |
| MAPREDUCE-5568 |
JHS returns invalid string for reducer completion percentage if AM restarts with 0 reducer. |
Major |
. |
Jian He |
MinJi Kim |
| MAPREDUCE-4879 |
TeraOutputFormat may overwrite an existing output directory |
Major |
examples |
Gera Shegalov |
Gera Shegalov |
| MAPREDUCE-4742 |
Fix typo in nnbench#displayUsage |
Trivial |
test |
Liang Xie |
Liang Xie |
| MAPREDUCE-4286 |
TestClientProtocolProviderImpls passes on failure conditions |
Major |
. |
Devaraj K |
Devaraj K |
| MAPREDUCE-3283 |
mapred classpath CLI does not display the complete classpath |
Minor |
scripts |
Ramya Sunil |
Varun Saxena |
| MAPREDUCE-2815 |
JavaDoc does not generate correctly for MultithreadedMapRunner |
Minor |
documentation |
Shane Butler |
Chris Palmer |
| YARN-3393 |
Getting application(s) goes wrong when app finishes before starting the attempt |
Critical |
timelineserver |
Zhijie Shen |
Zhijie Shen |
| YARN-3384 |
TestLogAggregationService.verifyContainerLogs fails after YARN-2777 |
Minor |
. |
Naganarasimha G R |
Naganarasimha G R |
| YARN-3369 |
Missing NullPointer check in AppSchedulingInfo causes RM to die |
Blocker |
resourcemanager |
Giovanni Matteo Fumarola |
Brahma Reddy Battula |
| YARN-3338 |
Exclude jline dependency from YARN |
Blocker |
build |
Zhijie Shen |
Zhijie Shen |
| YARN-3336 |
FileSystem memory leak in DelegationTokenRenewer |
Critical |
resourcemanager |
zhihai xu |
zhihai xu |
| YARN-3304 |
ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters |
Blocker |
nodemanager |
Junping Du |
Junping Du |
| YARN-3296 |
yarn.nodemanager.container-monitor.process-tree.class is configurable but ResourceCalculatorProcessTree class is marked Private |
Major |
. |
Hitesh Shah |
Hitesh Shah |
| YARN-3295 |
Fix documentation nits found in markdown conversion |
Trivial |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
| YARN-3287 |
TimelineClient kerberos authentication failure uses wrong login context. |
Major |
. |
Jonathan Eagles |
Daryn Sharp |
| YARN-3281 |
Add RMStateStore to StateMachine visualization list |
Minor |
scripts |
Chengbing Liu |
Chengbing Liu |
| YARN-3275 |
CapacityScheduler: Preemption happening on non-preemptable queues |
Major |
. |
Eric Payne |
Eric Payne |
| YARN-3270 |
node label expression not getting set in ApplicationSubmissionContext |
Minor |
. |
Rohit Agarwal |
Rohit Agarwal |
| YARN-3267 |
Timelineserver applies the ACL rules after applying the limit on the number of records |
Major |
. |
Prakash Ramachandran |
Chang Li |
| YARN-3256 |
TestClientToAMTokens#testClientTokenRace is not running against all Schedulers even when using ParameterizedSchedulerTestBase |
Major |
. |
Anubhav Dhoot |
Anubhav Dhoot |
| YARN-3255 |
RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options |
Major |
nodemanager, resourcemanager |
Konstantin Shvachko |
Konstantin Shvachko |
| YARN-3242 |
Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client |
Critical |
resourcemanager |
zhihai xu |
zhihai xu |
| YARN-3239 |
WebAppProxy does not support a final tracking url which has query fragments and params |
Major |
. |
Hitesh Shah |
Jian He |
| YARN-3238 |
Connection timeouts to nodemanagers are retried at multiple levels |
Blocker |
. |
Jason Lowe |
Jason Lowe |
| YARN-3237 |
AppLogAggregatorImpl fails to log error cause |
Major |
. |
Rushabh S Shah |
Rushabh S Shah |
| YARN-3231 |
FairScheduler: Changing queueMaxRunningApps interferes with pending jobs |
Critical |
. |
Siqi Li |
Siqi Li |
| YARN-3227 |
Timeline renew delegation token fails when RM user's TGT is expired |
Critical |
. |
Jonathan Eagles |
Zhijie Shen |
| YARN-3222 |
RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order |
Critical |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
| YARN-3207 |
secondary filter matches entites which do not have the key being filtered for. |
Major |
timelineserver |
Prakash Ramachandran |
Zhijie Shen |
| YARN-3194 |
RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node |
Blocker |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
| YARN-3191 |
Log object should be initialized with its own class |
Trivial |
nodemanager |
Rohith Sharma K S |
Rohith Sharma K S |
| YARN-3164 |
rmadmin command usage prints incorrect command name |
Minor |
resourcemanager |
Bibin A Chundatt |
Bibin A Chundatt |
| YARN-3160 |
Non-atomic operation on nodeUpdateQueue in RMNodeImpl |
Major |
resourcemanager |
Chengbing Liu |
Chengbing Liu |
| YARN-3155 |
Refactor the exception handling code for TimelineClientImpl's retryOn method |
Minor |
. |
Li Lu |
Li Lu |
| YARN-3151 |
On Failover tracking url wrong in application cli for KILLED application |
Minor |
client, resourcemanager |
Bibin A Chundatt |
Rohith Sharma K S |
| YARN-3149 |
Typo in message for invalid application id |
Trivial |
resourcemanager |
Bibin A Chundatt |
Bibin A Chundatt |
| YARN-3145 |
ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo |
Major |
. |
Jian He |
Tsuyoshi Ozawa |
| YARN-3143 |
RM Apps REST API can return NPE or entries missing id and other fields |
Major |
webapp |
Kendall Thrapp |
Jason Lowe |
| YARN-3131 |
YarnClientImpl should check FAILED and KILLED state in submitApplication |
Major |
. |
Chang Li |
Chang Li |
| YARN-3113 |
Release audit warning for "Sorting icons.psd" |
Major |
. |
Chang Li |
Steve Loughran |
| YARN-3104 |
RM generates new AMRM tokens every heartbeat between rolling and activation |
Major |
resourcemanager |
Jason Lowe |
Jason Lowe |
| YARN-3103 |
AMRMClientImpl does not update AMRM token properly |
Blocker |
client |
Jason Lowe |
Jason Lowe |
| YARN-3101 |
In Fair Scheduler, fix canceling of reservations for exceeding max share |
Major |
fairscheduler |
Anubhav Dhoot |
Anubhav Dhoot |
| YARN-3094 |
reset timer for liveness monitors after RM recovery |
Major |
resourcemanager |
Jun Gong |
Jun Gong |
| YARN-3090 |
DeletionService can silently ignore deletion task failures |
Major |
nodemanager |
Jason Lowe |
Varun Saxena |
| YARN-3089 |
LinuxContainerExecutor does not handle file arguments to deleteAsUser |
Blocker |
. |
Jason Lowe |
Eric Payne |
| YARN-3088 |
LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error |
Major |
nodemanager |
Jason Lowe |
Eric Payne |
| YARN-3082 |
Non thread safe access to systemCredentials in NodeHeartbeatResponse processing |
Major |
. |
Anubhav Dhoot |
Anubhav Dhoot |
| YARN-3079 |
Scheduler should also update maximumAllocation when updateNodeResource. |
Major |
. |
zhihai xu |
zhihai xu |
| YARN-3078 |
LogCLIHelpers lacks of a blank space before string 'does not exist' |
Minor |
log-aggregation |
sam liu |
|
| YARN-3074 |
Nodemanager dies when localizer runner tries to write to a full disk |
Major |
nodemanager |
Jason Lowe |
Varun Saxena |
| YARN-3071 |
Remove invalid char from sample conf in doc of FairScheduler |
Trivial |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
| YARN-3064 |
TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout |
Critical |
scheduler |
Wangda Tan |
Jian He |
| YARN-3058 |
Fix error message of tokens' activation delay configuration |
Minor |
. |
Yi Liu |
Yi Liu |
| YARN-3055 |
The token is not renewed properly if it's shared by jobs (oozie) in DelegationTokenRenewer |
Blocker |
security |
Yi Liu |
Daryn Sharp |
| YARN-3029 |
FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere |
Major |
nodemanager |
Steve Loughran |
Varun Saxena |
| YARN-3027 |
Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation |
Major |
. |
Anubhav Dhoot |
Anubhav Dhoot |
| YARN-3024 |
LocalizerRunner should give DIE action when all resources are localized |
Major |
nodemanager |
Chengbing Liu |
Chengbing Liu |
| YARN-3015 |
yarn classpath command should support same options as hadoop classpath. |
Minor |
scripts |
Chris Nauroth |
Varun Saxena |
| YARN-3010 |
Fix recent findbug issue in AbstractYarnScheduler |
Minor |
. |
Yi Liu |
Yi Liu |
| YARN-2997 |
NM keeps sending already-sent completed containers to RM until containers are removed from context |
Major |
nodemanager |
Chengbing Liu |
Chengbing Liu |
| YARN-2993 |
Several fixes (missing acl check, error log msg ...) and some refinement in AdminService |
Major |
resourcemanager |
Yi Liu |
Yi Liu |
| YARN-2992 |
ZKRMStateStore crashes due to session expiry |
Blocker |
resourcemanager |
Karthik Kambatla |
Karthik Kambatla |
| YARN-2991 |
TestRMRestart.testDecomissionedNMsMetricsOnRMRestart intermittently fails on trunk |
Blocker |
. |
Zhijie Shen |
Rohith Sharma K S |
| YARN-2990 |
FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests |
Major |
fairscheduler |
Karthik Kambatla |
Karthik Kambatla |
| YARN-2988 |
Graph#save() may leak file descriptors |
Minor |
. |
Ted Yu |
Ted Yu |
| YARN-2987 |
ClientRMService#getQueueInfo doesn't check app ACLs |
Major |
. |
Jian He |
Varun Saxena |
| YARN-2983 |
NPE possible in ClientRMService#getQueueInfo |
Major |
resourcemanager |
Varun Saxena |
Varun Saxena |
| YARN-2978 |
ResourceManager crashes with NPE while getting queue info |
Critical |
. |
Jason Tufo |
Varun Saxena |
| YARN-2977 |
TestNMClient get failed intermittently |
Major |
. |
Junping Du |
Junping Du |
| YARN-2975 |
FSLeafQueue app lists are accessed without required locks |
Blocker |
. |
Karthik Kambatla |
Karthik Kambatla |
| YARN-2972 |
DelegationTokenRenewer thread pool never expands |
Major |
resourcemanager |
Jason Lowe |
Jason Lowe |
| YARN-2964 |
RM prematurely cancels tokens for jobs that submit jobs (oozie) |
Blocker |
resourcemanager |
Daryn Sharp |
Jian He |
| YARN-2958 |
RMStateStore seems to unnecessarily and wrongly store sequence number separately |
Blocker |
resourcemanager |
Zhijie Shen |
Varun Saxena |
| YARN-2956 |
Some yarn-site index linked pages are difficult to discover because are not in the side bar |
Minor |
documentation |
Remus Rusanu |
Masatake Iwasaki |
| YARN-2952 |
Incorrect version check in RMStateStore |
Major |
. |
Jian He |
Rohith Sharma K S |
| YARN-2945 |
FSLeafQueue#assignContainer - document the reason for using both write and read locks |
Major |
. |
Tsuyoshi Ozawa |
Tsuyoshi Ozawa |
| YARN-2936 |
YARNDelegationTokenIdentifier doesn't set proto.builder now |
Major |
. |
Zhijie Shen |
Varun Saxena |
| YARN-2932 |
Add entry for "preemptable" status (enabled/disabled) to scheduler web UI and queue initialize/refresh logging |
Major |
. |
Eric Payne |
Eric Payne |
| YARN-2931 |
PublicLocalizer may fail until directory is initialized by LocalizeRunner |
Critical |
nodemanager |
Anubhav Dhoot |
Anubhav Dhoot |
| YARN-2922 |
ConcurrentModificationException in CapacityScheduler's LeafQueue |
Major |
capacityscheduler, resourcemanager, scheduler |
Jason Tufo |
Rohith Sharma K S |
| YARN-2917 |
Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook |
Critical |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
| YARN-2912 |
Jersey Tests failing with port in use |
Major |
test |
Steve Loughran |
Varun Saxena |
| YARN-2910 |
FSLeafQueue can throw ConcurrentModificationException |
Major |
fairscheduler |
Wilfred Spiegelenburg |
Wilfred Spiegelenburg |
| YARN-2907 |
SchedulerNode#toString should print all resource detail instead of only memory. |
Trivial |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
| YARN-2906 |
CapacitySchedulerPage shows HTML tags for a queue's Active Users |
Major |
capacityscheduler |
Jason Lowe |
Jason Lowe |
| YARN-2905 |
AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted |
Blocker |
. |
Jason Lowe |
Varun Saxena |
| YARN-2899 |
Run TestDockerContainerExecutorWithMocks on Linux only |
Minor |
nodemanager, test |
Ming Ma |
Ming Ma |
| YARN-2897 |
CrossOriginFilter needs more log statements |
Major |
. |
Mit Desai |
Mit Desai |
| YARN-2894 |
When ACL's are enabled, if RM switches then application can not be viewed from web. |
Major |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
| YARN-2874 |
Dead lock in "DelegationTokenRenewer" which blocks RM to execute any further apps |
Blocker |
resourcemanager |
Naganarasimha G R |
Naganarasimha G R |
| YARN-2870 |
Update examples in document of Timeline Server |
Trivial |
documentation, timelineserver |
Masatake Iwasaki |
Masatake Iwasaki |
| YARN-2869 |
CapacityScheduler should trim sub queue names when parse configuration |
Major |
capacityscheduler, resourcemanager |
Wangda Tan |
Wangda Tan |
| YARN-2865 |
Application recovery continuously fails with "Application with id already present. Cannot duplicate" |
Critical |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
| YARN-2861 |
Timeline DT secret manager should not reuse the RM's configs. |
Major |
. |
Zhijie Shen |
Zhijie Shen |
| YARN-2857 |
ConcurrentModificationException in ContainerLogAppender |
Critical |
. |
Mohammad Kamrul Islam |
Mohammad Kamrul Islam |
| YARN-2856 |
Application recovery throw InvalidStateTransitonException: Invalid event: ATTEMPT_KILLED at ACCEPTED |
Critical |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
| YARN-2847 |
Linux native container executor segfaults if default banned user detected |
Major |
nodemanager |
Jason Lowe |
Olaf Flebbe |
| YARN-2816 |
NM fail to start with NPE during container recovery |
Major |
nodemanager |
zhihai xu |
zhihai xu |
| YARN-2815 |
Remove jline from hadoop-yarn-server-common |
Major |
. |
Ferdinand Xu |
Ferdinand Xu |
| YARN-2811 |
In Fair Scheduler, reservation fulfillments shouldn't ignore max share |
Major |
. |
Siqi Li |
Siqi Li |
| YARN-2809 |
Implement workaround for linux kernel panic when removing cgroup |
Major |
nodemanager |
Nathan Roberts |
Nathan Roberts |
| YARN-2808 |
yarn client tool can not list app_attempt's container info correctly |
Major |
client |
Gordon Wang |
Naganarasimha G R |
| YARN-2749 |
Some testcases from TestLogAggregationService fails in trunk |
Major |
. |
Xuan Gong |
Xuan Gong |
| YARN-2742 |
FairSchedulerConfiguration should allow extra spaces between value and unit |
Minor |
fairscheduler |
Sangjin Lee |
Wei Yan |
| YARN-2735 |
diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection |
Trivial |
nodemanager |
zhihai xu |
zhihai xu |
| YARN-2731 |
Fixed RegisterApplicationMasterResponsePBImpl to properly invoke maybeInitBuilder |
Major |
. |
Carlo Curino |
Carlo Curino |
| YARN-2713 |
"RM Home" link in NM should point to one of the RMs in an HA setup |
Major |
resourcemanager |
Karthik Kambatla |
Karthik Kambatla |
| YARN-2697 |
RMAuthenticationHandler is no longer useful |
Major |
resourcemanager |
Zhijie Shen |
haosdent |
| YARN-2675 |
containersKilled metrics is not updated when the container is killed during localization |
Major |
nodemanager |
zhihai xu |
zhihai xu |
| YARN-2637 |
maximum-am-resource-percent could be respected for both LeafQueue/User when trying to activate applications. |
Critical |
resourcemanager |
Wangda Tan |
Craig Welch |
| YARN-2461 |
Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfiguration |
Minor |
. |
Ray Chiang |
Ray Chiang |
| YARN-2432 |
RMStateStore should process the pending events before close |
Major |
resourcemanager |
Varun Saxena |
Varun Saxena |
| YARN-2414 |
RM web UI: app page will crash if app is failed before any attempt has been created |
Major |
webapp |
Zhijie Shen |
Wangda Tan |
| YARN-2356 |
yarn status command for non-existent application/application attempt/container is too verbose |
Minor |
client |
Sunil G |
Sunil G |
| YARN-2340 |
NPE thrown when RM restart after queue is STOPPED. There after RM can not recovery application's and remain in standby |
Critical |
resourcemanager, scheduler |
Nishan Shetty |
Rohith Sharma K S |
| YARN-2315 |
FairScheduler: Set current capacity in addition to capacity |
Major |
. |
zhihai xu |
zhihai xu |
| YARN-2246 |
Job History Link in RM UI is redirecting to the URL which contains Job Id twice |
Major |
webapp |
Devaraj K |
Devaraj K |
| YARN-2243 |
Order of arguments for Preconditions.checkNotNull() is wrong in SchedulerApplicationAttempt ctor |
Minor |
. |
Ted Yu |
Devaraj K |
| YARN-2230 |
Fix description of yarn.scheduler.maximum-allocation-vcores in yarn-default.xml (or code) |
Minor |
client, documentation, scheduler |
Adam Kawa |
Vijay Bhat |
| YARN-2136 |
RMStateStore can explicitly handle store/update events when fenced |
Major |
. |
Jian He |
Varun Saxena |
| YARN-1703 |
Too many connections are opened for proxy server when applicationMaster UI is accessed. |
Critical |
. |
Rohith Sharma K S |
Rohith Sharma K S |
| YARN-1615 |
Fix typos in description about delay scheduling |
Trivial |
documentation, scheduler |
Akira AJISAKA |
Akira AJISAKA |
| YARN-1580 |
Documentation error regarding "container-allocation.expiry-interval-ms" |
Trivial |
documentation |
German Florez-Larrahondo |
Brahma Reddy Battula |
| YARN-1453 |
[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments |
Minor |
. |
Andrew Purtell |
Akira AJISAKA |
| YARN-1237 |
Description for yarn.nodemanager.aux-services in yarn-default.xml is misleading |
Minor |
documentation |
Hitesh Shah |
Brahma Reddy Battula |
| YARN-933 |
Potential InvalidStateTransitonException: Invalid event: LAUNCHED at FINAL_SAVING |
Major |
resourcemanager |
J.Andreina |
Rohith Sharma K S |
| YARN-570 |
Time strings are formated in different timezone |
Major |
webapp |
Peng Zhang |
Akira AJISAKA |


The pretty html version of this file can be found here: http://pysnirf.readthedocs.io/en/latest/
pysnirf¶
pysnirf is a suite of python programs used to read and write standard near infrared format files (.snirf file). It aims to comply with the file specification set out here: https://docs.google.com/document/d/1EKEMrB6CxmEGnzI4zi7MugHq318HRaR3M2i_vzRIPFU/edit?usp=sharing
Introduction¶
Python version compatibility:¶
This code has been tested in python 2.7, 3.5, and 3.6. I try very hard not to use any version dependant features when I write programs, so it will probably work on any subversion of python 3. I think there is some weirdness in the python’s numerical routines in versions 2.6 and below, so no guarantees it will work in anything lower than 2.7.
How do I cite this?¶
Don’t know yet.
What’s included in this package?¶
For the time being, I’m including the following:
snirftest¶
Description:¶
This script writes a sample snirf file, filling most of the fields in the spec, then reads it back. This proves that the library is compatible with itself, which isn’t nothing, but it isn’t much.
Inputs:¶
None
Outputs:¶
Creates the file ‘testfile.snirf’ in the run directory.
Usage:¶
snirftest - create a test snirf file usage: snirftest
snirflib¶
Description:¶
snirflib is the library that actually does everything. This is likely to get completely rewritten, but at the moment it works. It has two main functions
Functions:¶
read_snirf(filename)write_snirf(name,thisdata,thisSD,thisstim,metadict,theaux=[], debug=False) (and some routines for initializing arrays).


Clinton: {{democrates}}%
Trump: {{repulicans}}%
Embed the following link to show chart in your webpage. Embedding and sharing is free for everyone. The content is dynamic, i.e. numbers and text change in accordance with the data.


Experience
-
Work & CoSenior Developer, Sept 2016–present
-
Led the state data modeling, overall state management and
project architecture on a React project building a touch-screen
based project.
-
Led the API contract, state data modeling, and overall state
management on a React Native project for a large restaurant
chain, using RESTful endpoints, Redux and Redux Saga.
-
Built a component-based solution compatible with the constraints
of the client’s CMS and e-commerce platform, allowing use of
modern React for Aesop’s redesigned web experience.
-
Contributed with React component development, modern CSS styling
using PostCSS and state management using Redux or GraphQL on a
handful of projects.
-
Mentored teammates on back end development and best practices
while developing mock API services using Node.js.
-
Created and managed an internal email newsletter to highlight
people’s work, learnings, and shared content, and promote a
better community.
-
Booking.com
Client-side developer, May 2014–Sept 2016
-
Led a complete refactor of the website search boxes, including
libraries used to autocomplete locations, aiming to reduce
complexity and dependency on outdated jQuery UI plugins.
-
Developed the design system components used on the Booking.com
for Business application.
-
Designed and developed a component-based system that aimed to
better organize the scattered HTML, CSS and JavaScript files the
website was based on, improving the developer experience and
velocity.
-
Provided mentoring for development interns on career development
inside the company.
-
Scup.com
Front-end engineer, May 2013–April 2014
-
Univision.com
Lead PHP Developer, July 2012–May 2013
-
MTV Brasil
PHP Developer, April 2010–July 2012
-
Connix
PHP Developer, April 2008–February 2010
-
Netcash
Junior PHP Developer, April 2006–April 2008


I haven’t been posting in a long time and to get back into it. Still not having a GMail Account, I needed something else and nice to post and this time, it will just be something I found via Adam Curry’s Weblog, namely, Eric Idle’s FCC Song. Yes, that’s the Monty Python Eric Idle. The one and only. One of the masters. You can download the song right here. Great stuff.
Why My Former Employees Still Work for Me by Ricardo Semler
I love what Ricardo Semler is doing, just so we are clear on that one. I suggest you read Maverick by Ricardo Semler, a great read. But anyone. To start with this article, a short quote from the third line: no one in the company really knows how many people we employ.
<!– more –>
First the employment and contractual relationships are very complex and second Ricardo believes it is useless information. They have employees, part-time employees, ex-employees, and other people on their premises. Some work for them, some for themsleves. Most on Semco’s machines. Others on othre machines. It can be frustrating as it is uncontrollable and requires a daily leap of faith and has serious implications for corporate security. It has been working very well for three years.
Ricardo goes on by saying: I think that strategic planning and vision are often barriers to success. He also believes in responsibility, disputes the value of growth, and doesn’t think you can measure success in numbers. He doesn’t govern Semco, owns the capital but not the company and it is run based on three values: employee participation, profit shring, open information systems. They are treating their employees like responsible adults. Participation gives people control of their work, profit sharing gives them a reason to do it better and information tells them what’s working and what isn’t.
This also means that they needed to accept democratic decisions they disliked. In general Semco survived because they surrounded themselves with people who look at everything they do and think about doing it better, cheaper, faster or just totally different.
The control part is interesting too. They have six counsellors, each acting as CEO for 6 months. They also do six months budgets and the CEO tenure is shifted 3 months to those budgets. Nobody can relax as everybody will be CEO again soon but at the same time, nobody is responsible on their own.
All meetings are open and optional and those that attend make decisions that those who don’t may simply have to live with.
Their first principle is the ultimate source of all power, and because of this, it is made available to everyone. The person who knows most about the subject chairs meetings. The second principle is that responsibility for any task belongs to the person who claims it. Third, profit sharing and success-oriented compensation spreads responsibility. People try hard to stay aware of everyone else’s performance.
Whoever holds the spear is completely in charge of bringing down the mammoth.
They might have to worry about leaks but it’s a waist of time. First competition comes from companies they never heard of before. Second you don’t win by knowing the other companies 10-K. Strategic Planning in his mind is useless as he believes that it makes things happen that fly full in the face of reality and opportunity. They found more things bottom up than they could with strategic planning he believes.
We have little control, even less organization and no conventional discipline at all. Yet they build rocket-fuel propellant mixers for satellites.
Empowerment: The Emperor’s New Clothes by Chris Argyris
Argyris believes that major changes programs are rife with inner contradictions. The current advice for promoting organizational change has four steps: - Define a vision - Define resulting competitive strategy - Define the work processes - Define job requirements
In the end, this means you are defining employee actions from the outside and the resulting behaviour cannot be empowering and liberating. You get a "do your own thing - the way we tell you" system.
<!– more –>
CEOs generally undermine empowerment as they link empowerment with tight job requirements and controlled processes. Argyris argues this does not lead to an environment that is empowering but one that is foolproof. Often champions are appointed but the employee will see that person as somebody who wants to sell the empowerment to them, top down, where they would come themselves if they were internally committed.
Employees have their doubts and commitment can be said to be a psychological survival mechanism. In east germany for example, employees learned to survive by complying. It can then be very threatening to suddenly be asked to be internally commited and no longer controlled from the outside. The longer you have external commitment, the harder it is to move to an internal system. A reward system will also rather create dependency and not empowerment. Empowerment might just be too much work for a lot of people.
Change preferessionals inhibit empowerment in many cases as they have a conflict of interests inherent in empowerment. Once the initial excitement wears down, employees will have problems and when they do, they will want to ask their managers, which is ok, but goes against the idea of empowerment.
When change is started without the limitations of empowerment being recognized.
How to Kill Creativity by Teresa Amabile

Amabile argues that creativity is a function of three components: expertise, creative thinking skills, and motivation.
<!– more –>
Managing creativity was what Amabile researched and she has found six general categories that are important for the manager.

Challenge You need to match people with the right assignements, with the perfect stretch. This means you need to know the people and the assignements.

Freedom You need to give people the autonomy concerning the means/process but not necessarily the end. In some way I might even argue that some people need to know the end and don’t want to find it themselves. If you set the goals, you need to make sure that they stay stable or meaningful for a longer period in time, as switching goals kill freedom. Autonomy needs to be really granted, not only in name.

Resources You have time and money to consider here. Time pressure can heighten creativity or kill it. Increasing intrinsic motivation through a challenge is good. Fake deadlines help noone and create distrust. What are the funds a team needs to complete their assignement. Adding more resources above what is sufficient will not boost creativity (Comment: depends on definition of sufficient). But keeping resources too tight means people’s creativity goes into finding resources. Creative teams need open and comfortable offices.

Work-group features You must create mutually supportive groups with diversity of perspectives and backgrounds. Everyone must share the excitement over the team’s goals and be willing to help each other and recognize the unique knowledge and perspective that everyone brings. You as a manager need to understand their problem-solving styles and their motivational hot buttons. While homogeneous teams reach solutions more quickly they also agree too fast, killing creativity.

Supervisory encouragement To sustain passion people need to feel that their work matters. I would like to extend this to the fact that it needs to matter for something they care about. You need to recognize creative work without offering specific rewards. Remember that ideas must be new and useful but dead ends can end up being enlightening. you might try to serve as a role model.

Organizational support Creativity flourishes when the entire organization supports it. support does not mean bribing people though. Information sharing and collaboration is important.

Creativity and Perception in Management: Creative Management

We now assume that to add value in our developed economies, we need creativity and innovation. We are shifting from an industrial to the information age with higher pace of change, more uncertainty and a need for more responsive and flexible management. As we need cost reductions, speed increases, flexibility, … downsizing, delayering, divesting is common. We need to become more efficient. We need to partner and form alliances. And management in all of this is more about perception and facilitation than analysis and control. Creative managmeent is about changing the way organizations are run, opening up their climate and management style, increasing participation and freedom. Enable the organization to innovate and network. Creative management is linked here to transforming organizations while managing innovation is about new product development.
<!– more –>
Creative Leaders

A creative leader has a vision, is charismatic enough to inspire others to follow that vision. A creative manager’s role is to attend social needs, ensure open atmosphere and see that ideas can be brought to fruition. Kanter (1991) argued that creative leaders formulate the idea and have the power to advance it. They are good communicators and build coalitions, work through teams and are persistent. They can communicate their vision, inspire and carry their dreams into reality. They have very good social skills.

This is linked to Goleman’s (1998) idea of emotional intelligence: self-awareness, self-regulation and motivation to manage yourself and empathy and social skill to management relationships.

There are different leaders though, who could be the Visionary, Entrepreneurial or Transformational leader. Ricardo Semler (1994) goes even further with the self-organizing company. Further information on the different leadership styles can be seen on page 26 of the book.

Creative Managers

Creative endavor is only likely with committed staff. Empowerment and network is key and Morgan (1991) highlights the following properties for today’s managers: - Reading the environment - Proactivity - Visionary Leadership - Human Resource Management - Remote Management Skills - Using IT to transform - Managing complexity - Contextual Competencies

We are moving into an environment where the manager has far less control and has more of a facilitative role. In general, I agree here to the extent that a good manager will make your job easier and this is not about control but it is very hard to let go as a manager. You protect teams from unnecessary obstacles.

You need to have the ability to look at situations from different perspectives, taking an overview. Senge (1991) wrote about the importance of mental models and Kanter (1991) used the analogy of a kaleidoscope. Understand the logic and concerns behind different stakeholders’ position is very important.

To be facilitating you need to also allow for sufficient autonomy while still giving stretch and challenge. Kanter (1997) believed you need to offer learning opportunities. Proactivity is about being prepared, potentially using scenarios to play different situations out beforehand. Networking is key because ideas emerge in social settings and employee loyalty is often more to an industry than the firm.

Creative Teams

Successful teams include people from different styles and backgrounds. There will be a mix of characters. Innovators often competors in their teams for example. Belbin (1988) included the following roles in a team: leaders (task oriented shaper and people oriented chair person), ideas person (creator or plant), resource investigator, monitor-evaluator, team worker, implementer and completer. He later added the specialist.

You often need multi-disciplinary teams with a project leader and (comment: a great sounding job!) the technological gatekeeper who keeps his technical knowledge upt to date through informal networking, as well as a product champion or business sponsor who steers the product through the orgnanization.

The climate needs to be one of freedom, trust, commitment and diversity. Freedom and control of your own work along with good project management and some system of encouragement and feedback are good. Trust is only likely possible in groups of 50 people or less. Pearson (1989) argued for a clear strategy and Kanter (1997) for common values. Stacy (1996) emphasised the capacity to accept ambiguity and uncertainty.

Organizational Change

Lots of things are tried here, including continuous improvement, benchmarking, quality, learning, development, knowledge-sharing initiatives, … . Re-engineering is another idea while Semler’s book Maverick, about his own company Semco offeres another radical idea. Remember that most organizational change fails.

In the end, the manager needs to care for employee development, foster collaboration and commitment.

Creativity and Perception in Management: Creativity

Change and globalization are leading to creativity growing in importance. Technological innovation has led to an increasing pace of change. Handy (1991) suggests that things are developing so fast that you can only expect the unexpected. That’s the only certainty you have. Due to globalization and the internet, barriers of entry to markets are being lowered and there is ever-increasing competition and pace of change. You need to be creative enough to add value through continual innovation. While previously value was being added through labour, land or capital, this is now happening through creativity, knowledge, innovation and learning.
<!– more –>
Nature and Origins of Creativity

Creativity generally has two characteristics: newness and appropriateness, where newness means that some idea seems novel to the perceiver. Before the 1990s, most researchers believed that creativity was an ability, linked to mental flexibility and relevant experience. It was also being linked to intrinsic motivation but only later did the effect of work climate and environment be recognized to play an important role. The social context is important.

Individual Characteristics

Creative people do the unexpected, are original, have a dream or purpose and are very determined. Lesser characteristics are flexibility and a positive outlook. One of their abilities seems to be that of finding problems, finding the important question and they can tolerate ambiguity. The importance of a special trait has decreased considerably over the years. Style however is gaining importance, especially focussing on incremental improvements, an adaptive style of creativity.

When creativity is seen as a mental skill, one about mental flexibility, being able to withhold judgement and shift perspectives. This can be taught though, meaning that this skill is transferable, even though it is only part of the story.

This already shows though, that to have a creative organization, you need to allow thinking out of the box, foster a positive outlook no matter what, tolerate uncertainty and stress the importance of questioning everything. Add open (really open, not want to be open) communications and you can get there.

Experience, Knowledge and Motivation

I’ll start with a quote here, as it fits just a little bit:

Hire and promote first on the basis of integrity; second, motivation; third, capacity; fourth, understanding; fifth, knowledge; and last and least, experience. Without integrity, motivation is dangerous; without motivation, capacity is impotent; without capacity, understanding is limited; without understanding, knowledge is meaningless; without knowledge, experience is blind. Experience is easy to provide and quickly put to good use by people with all the other qualities. - Dee Hock

Now let’s see what the course has to say. Creative people seem to have relevant experience but they still value chance. The experience services as an easy access point to different scenarios. In this sense, expert recognition is very important, meaning older and more experience staff will have more creativity, provided that the climate lets them.

Amabile (1983) suggested that neither mental flexibility nor relevant experience are sufficient, but thye need to be combined with intrinsic motivation. The problem with intrinsic motivation really is that it is very individual, different for everyone. People will be most creative in areas that they are most interested in.

Context of Creativity

Work climate and culture are important, as people will do more exploring when they feel safe. Then you need to trust that it will emerge, because it cannot be fored. You need to give freedom and tolerate mistakes and allow people more time to communicate with each other.

Freedom is the greatest when the ground rules are clear. Chalk out the playing field and say, Within those lines, make any decision you need. - Dick Brown, chairman CEO of EDS

The soecial context is gaining importance with Csikszentmihalyi (1996,1999) looking at the aspects of the creative individual, domain of knowledge and the social field. He found that there are some fields that lead to more innovation, bringing in the point that what has gone before is important, and you need to allow people to connect.

Emergent creativity borrows from complexity theory in which very complex systems seem to be capable of self-regulation. Creativity is likely to occur at the edge of chaos.

Changing Conceptions

Creativity research looked at the who, how and getting around barriers. Innovation research looked at how ideas reach the market and knowledge management recognizes the importance of local knowledge.

Following is a very good table from the books summarizing everything up till now a little bit.

Cause	Strategy	Implications

Ability	Trait	Identify creative abilities	Not everyone is creative

	Style	Balance styles in teams	All people are creative

Competence	Skill	Develop creative skills	Transferable skill

	Attitude	Remove perceptual blocks	Transferable skill

Experience	Application	Develop expert recognition	Domain dependent

	Motivation	Build in personal freedom	Domain dependent

Context	Climate	Encourage open climate	All people are creative but are more likely to be so in open environments

	Field	Nurture creative networks	All people are creative but will not be recognised as such unless their idea is accepted by their field’s judges and opinion makers

The ideas of creativity have changed from a chosen few to everybody, redical to incremental, unique to new to you and ideas to implementation.

How do you develop your creativity? Model yourself against traits of creative people. Think positive and look for opportunities at all times. Be playful and take risks. Do things with passion and persistence.

In the end, personality, mental flexibility, experience, motivation, organization climate and social context all play a small part in the quest for creativity.

YaGoogle!
So what would Google look like if they used the same layout as Yahoo! does for their frontpage. Anil Dash took the Yahoo! front page and greyed out the areas of services that Google doesn’t have. Thanks Anil. Check it out: Anil Dash: Portalization
The Industrialized Revolution
Remember disruptive innovation? There is a very nice article at FastCompany about this at the moment, giving a good overview of the problem.
"It was as if everybody clapped their hands and suddenly the managers who had been so revered were vilified," recalls Christensen, with a sad shake of his head. "The dumb-manager theory of business problems just didn’t hold water for me. There had to be a deeper reason why smart people would make decisions that lead to failure. I wanted to know why. Why is it so hard to sustain success? Why do good companies fail?" - Fast Company | The Industrialized Revolution
They also point to Innosight, founded by Clayton Christensen to be a disruptive consultancy in the world of McKinseys. They are argueing that they can make you a growth business far cheaper than these guys can. That might be a company to watch, especially with theorists often not being the best practitioners.
What a Sight
Creating Personal Wealth With Blogs
Currently the discussion is going on how to make money with blogs and I do believe the discussion is flawed. First of all, we have to remove from the discussion group blogs or subject focussed blogs that have been launched partly to make money. They have a standard problem like any media company has and they are just using a blogging tool as their content management system. This is not what this should be about…
<!– more –>
What I am talking about is the standard blogs, by people, by groups, as a labor of love, of dedication. These that don’t want to be a media company, those that don’t want to go managing their cash flow. For those, there is a lot broader of a picture.
Jeremy C. Wright has somehow become a source of authority about Google and is moving closer to his dream of working at Microsoft, via blogging. Joi Ito, venture capitalist, has been thinking to focus more on blogging, both in business and in his personal life. Ingmar Bornholz is taking the idea as far as to think about an open company via his blog and he just started. Loic le Meur started a bit over a year agoa and just set up the World Economic Forum Blog. Ralf Beuker is blogging his teacher life and set up a group blog for his Design Management course. Jeremy Zawodny is using his blog to find new employees for Yahoo! and educated the world by blogging his housing hunt and buying.
This list could go on and on, but these people have a few things in common. they are not making money vie their blog as such but thy are creating wealth. Wealth for society at learge and for themselves. Far beyond monetary wealth.
This is what this is about. This is why this is a lot deeper than simply making money with blogs. Loic le Meur wouldn’t have to build up another company but first of all I think he can’t not do it and second, which is the important point, is building somethingthat can change society for the btter.
We are moving to power back to the people with this. The media amazing power and will continue to have that but this is like enabling a counter weight. The question here would be how the individual would value having her voice heard? The internet is not about control, but about the free flow of information, enabling a lot of view points to be out there and public and for open discussion to take place. It will be and is uncontrollable and shouldn’t be. Yes, some radical views will be out there too but there will be a discussion about them.
How do you value sometimes possibly getting financial and personal reward for getting sombody a job? How do you value building up your name through sudden interviews with the press? How do you value getting your dream job? How do you value getting eedback from fellow MBA students at a meeting tell you they love your blog showing print outs which they read on the way to the meeting? How do you value helping somebody with a problem they have?
Most importantly, in a world where the power is moving back to the employee, the employee willing to take more risk and take charge of their own life, moving arround easily and readily and not being bound down by one corporation? My knowledge isn’t in here but the depth of it can be guessed and seen and I will be more likely to be approached for a job that I would care about than anything else.
This is where the value of blogging comes from and this cannot be measured with money alone. Money will only allow you to do this without cost and this can be done with a free blogging service too. If you want more power of expression, you might have to pay for more powerful software, but then you have a view of yourself that is a lot clearer and you will be willing to pay for that. The meetings I had with people through this blog are already worth a lot more than the money I pay for my TypePad account. And this is only the beginning.
Welcome to your power.


Technologies: JEE, Python, Apache Spark, AJAX, Apache Tomcat Posted by Bijoyan Das on August 3, 2017
Technologies: JEE, Apache Tomcat, Oracle 11G Posted by Bijoyan Das on March 16, 2017
Technologies: Java, Android, XML Posted by Bijoyan Das on March 12, 2017
Technologies: Python Posted by Bijoyan Das on October 22, 2017


A data access object (DAO) is an object that provides an abstract interface to some type of database or other persistence mechanism.
class UserDAO {
function getAll() {..}
function save(User $user) {..}
function delete(User $user) {..}
...
}
the singleton pattern is a design pattern that restricts the instantiation of a class to one object.
Some ressources should not be loaded more than once because they can be shared across the application. This is mostly for cost or simplicity related reasons.
class DB {
private static $instance;
private function __construct() {..}
static public function getInstance() {
if (self::$instance === null) {
self::$instance = new DB();
}
return self::$instance;
}
}
MVC : Model - View - Controller
The controller should manage all interaction between the application and the client.
Take all information from the request,
Perform some actions,
Return a response
In a web based context, that means : checking credentials, checking the routes, performing actions based on the route, parse the form and execute the related actions, etc. Eventually, it should return a response.


CWE Base Score Calculation
03 May 2018CWE stands for common weaknesses enumeration. It is used as a tool to standardize the degree of weakness that a vulnerability in an environment poses. Compared to CVE (Common Vulnerabilities and Exposures), CWEs are normally related to how an instance of the program is configured, rather than vulnerabilites with the underlying program itself. The score of each CWE is calculated by the CVSS: Common Vulnerability Scoring System.
Score Severity Chart
| Severity | Base CWE Score Range |
|---|---|
| None | 0.0 |
| Low | 0.1 - 3.9 |
| Medium | 4.0 - 6.9 |
| High | 7.0 - 8.9 |
| Critical | 9.0 - 10 |
Breakdown of base score metrics
Each section contains the metric’s potential values in order of decending value. Each metric has an abreviation associated to see a CVSS score breakdown at a glance.
Calculator
A calculator for CVSS score can be found at nvd.nist.gov. In addition I will explain how the base scoring works.
Exploitability Metrics
Exploitability metrcis pertain to the specific circumstances that a vulnerability is exploitable.
Attack Vector (AV)
Attack vector is a description of how the attacker reaches the vulnerable entity.
- Network (AV:N)
- The vulnerability is accessable over OSI layer 3 (Network).
- Generally these are considered remotely exploitable because the attacker is not restricted in physical location.
- Adjacent Network (AV:A)
- The vulnerability is accessable over OSI layer 2 (Data Link).
- This attack vector could be bluetooth or same subnet of the network.
- This means that if the attacker must cross a router, then they would not a threat.
- Local (AV:L)
- The vulnerability relies on components not bound to the network stack.
- For example, if the vulnerability requires the attacker to have write permissions to a file.
- Physical (AV:P)
- The attacker must be able to touch the target or a device directly connected to the target.
Attack Complexity (AC)
The amount of control the attacker has on variables that will affect the outcome of the attempted exploit.
- Low (AC:L)
- The attacker can expect reliable results when exploiting the vulnerability.
- High (AC:H)
- The outcome of the attempt relies on variables outside of the attacker’s control.
Privileges Required (PR)
The access level required to exploit the vulnerability beforehand.
- None (PR:N)
- The attacker does not require any level of escalated privilages.
- Low (PR:L)
- The vulnerability requires the attacker to be minimally authenticated.
- The vulnerability may only require access to non-sensitive resources.
- High (PR:H)
- The attacker must have control over system wide settings or files.
User Interaction (UI)
Does the vulnerability require the user’s permission or interaction?
- None (UI:N)
- Nope.
- Required (UI:R)
- The user is required to click a link, or open a specific program.
Scope (S)
Does the attacker gain more access to the system by using this vulnerability?
- Unchanged (S:U)
- The attacker gains no extra priviledges or access.
- Changed (S:C)
- The attacker gains access to data they did not have access to previously.
Impact Metrics
Impact metrics are an attempt to explain how badly the target is affected by the vulnerability, if an attacker exploits it.
Confidentiality Impact (C)
Will the organization hosting the vulnerability leak information that could be used for evil?
- None (C:N)
- No information was lost in the attack.
- Low (C:L)
- The attacker either does not have control of information obtained.
- The amount of data that can be obtained is restricted.
- The information lost is not critical.
- High (C:H)
- All information is lost.
- Only some access is gained, but the information leak presents a serious issue.
Integrity Impact (I)
Can the attacker change data that they have access to.
- None (I:N)
- No information can be modified in the attack.
- Low (I:L)
- The attacker either does not have control of information imodified.
- The amount of data that can be modified is restricted
- The information lost is not critical.
- High (I:H)
- All integrity is lost.
- Only some data is modified, but the information leak presents a serious issue.
Availability Impact (A)
Will the attack be able to restrict others from utilizing resources?
- None (A:N)
- No, the attacker cannot deny access to the resource.
- Low (A:L)
- The attacker can only reduce performance, even if repeated exploitation is possible.
- The attacker is still restricted in how they can deny service.
- High (A:H)
- The service can be fully blocked.
- If not fully blocked, the consequences are a serious issue.
- Perhaps the attacker cannot close already established connections, but block new ones.
Optional Base Score Tweaks
There are also Temporal Score Metrics and Environmental Score Metrics, but they only modify the base score. The base score is what the temporal and envirenmental scores are based on.
- Temporal Score Metrics
- Changes to the base score based on what tools can be used to exploit or patch the vulnerability in the present day.
- Environmental Score Metrics
- These metrics closely resemble the base score metrics, but focus on the environmental circumstances required.


Gate computer science is one of the most sought exams if we talk about Computer Science and Engineering. Because of its usefulness, competition in GATE CSE is increasing every year. Every year at least 1 lakh student appears for Gate Computer Science. In this blog, we will talk about why we should plan to appear in the GATE and start preparing for the GATE as soon as possible. What may be the long term and short term benefits of appearing in GATE?
If you are appearing for GATE and preparing for the exam very rigorously. I can bet, your technical knowledge of various computer science areas such as Operating System, Computer Networks, DBMS, Computer Architecture is going to be really good. Although you will be learning very old things, still you can relate to every subject with today’s computers. If one is appearing for the interview of some product-based companies such as Amazon, Flipkart, Paytm, etc, there will be at least one round where you will be asked in-depth questions from these subjects. So in that scenario, knowledge of these subjects is going to be highly helpful for you.
There are some students, who has a burning desire to enter into IITs/IISc and During JEE could not fulfill their dream, for such people GATE provides a golden opportunity to fulfill their dream to study in such premier institutes.
Although PSUs are famous among the students of core engineering branches such as Mechanical, Civil, Electrical, etc. But a computer science student can also go for PSUs, we just need to get a good rank mostly under 100. Initial salary and perks in PSUs are really good. But most of the students with that much rank generally prefer to go for IITs or IISc for Masters. So PSUs are a really good option for a computer science student.
If we talk about normal private colleges, most of the students get placed in service-based companies. These companies do not pay good enough to live a lavish life in a metro city. But once you enter into the IIT system and that too with the computer science branch. Your life is going to be changed completely. Its a fact that almost all the IITs except a few new ones, most of them have an average placement of 15+ lakh per annum.  You yourself can not imagine, how you and your parent’s life is going to change. For 90% of the student, it is the biggest motivation and it should be.
All the people who did not take you seriously, now they will take you seriously. The answer you are going to write over quora, LinkedIn post, etc are going to get a lot many numbers of likes/upvotes (don’t know about Facebook). Some of the companies or coaching institutes may approach you for the paid promotion over these platforms.
In this world, there are only 2 people who loves you more than anything else in the world and those two people are your parents. Once you clear the GATE, the happiness that you are going to see on there face is just an unique experience. Now they are going to tell people proudly that their son/daughter is studying/working in such an Institute/Organization. It happens with me, whenever I go to my home and if there is any family gathering, my parents proudly say that our son is the student of an IIT. You can clearly see the happiness and satisfaction on their faces.
This article is contributed by Karan Kumar Rajput. Click Here To Read More Articles.


which is non-standard. Use builtin 'command -v' instead.
which grep
command -v grep
which
is a non-standard, external tool that locates an executable in PATH. command -v
is a POSIX standard builtin, which uses the same lookup mechanism that the shell itself would.
None
With BASH 5.0.7 (via homebrew on macOS 10.13.6), command -v
appears to take multiple parameters:
# grep is in /usr/bin/grep
# foobar is not in path
#
$ command -v -- grep foobar; echo $?
0
but succeeds (with exit code 0) if any command exists. In the above example, it should have failed and exited with 1 unless all commands exist.
An alternative is:
$ hash <file1> <file2>
Which observes the standard behaviour of failures.


Dashboard
Company Overview
Business Balance
Loading...
Department Balance
Loading...
Department Employee Count
Loading...
Current Outgoing Transactions
Loading...
Active Plans
Loading...
Plan Fund Average 6 month overview
Loading...
Per Department Fund Allocation
Loading...
Monthly Spending
Loading...
| ID | Name | GPA Balance | Spending ($) |
|---|
Per Department Utilization
Loading...
Monthly Overall Employee Spending
Loading...