title: Four Billion Year Stability of the Earth-Mars Belt

abstract: Previous work has demonstrated orbital stability for 100 Myr of initially near-circular and coplanar small bodies in a region termed the 'Earth-Mars belt' from 1.08 au $< a <$ 1.28 au. Via numerical integration of 3000 particles, we studied orbits from 1.04-1.30 au for the age of the Solar system. We show that on this time scale, except for a few locations where mean-motion resonances with Earth affect stability, only a narrower `Earth-Mars belt' covering $a\sim(1.09, 1.17)$ au, $e<0.04$, and $I<1^\circ$ has over half of the initial orbits survive for 4.5 Gyr. In addition to mean-motion resonances, we are able to see how the $\nu_3$, $\nu_4$, and $\nu_6$ secular resonances contribute to long-term instability in the outer (1.17-1.30 au) region on Gyr time scales. We show that all of the (rather small) near-Earth objects (NEOs) in or close to the Earth-Mars belt appear to be consistent with recently arrived transient objects by comparing to a NEO steady-state model. Given the $<200$ m scale of these NEOs, we estimated the Yarkovsky drift rates in semimajor axis, and use these to estimate that primordial asteroids with a diameter of 100 km or larger in the Earth-Mars belt would likely survive. We conclude that only a few 100-km sized asteroids could have been present in the belt's region at the end of the terrestrial planet formation.


title: Optimal Control of a Soft CyberOctopus Arm

abstract: In this paper, we use the optimal control methodology to control a flexible, elastic Cosserat rod. An inspiration comes from stereotypical movement patterns in octopus arms, which are observed in a variety of manipulation tasks, such as reaching or fetching. To help uncover the mechanisms underlying these observed morphologies, we outline an optimal control-based framework. A single octopus arm is modeled as a Hamiltonian control system, where the continuum mechanics of the arm is modeled after the Cosserat rod theory, and internal, distributed muscle forces and couples are considered as controls. First order necessary optimality conditions are derived for an optimal control problem formulated for this infinite dimensional system. Solutions to this problem are obtained numerically by an iterative forward-backward algorithm. The state and adjoint equations are solved in a dynamic simulation environment, setting the stage for studying a broader class of optimal control problems. Trajectories that minimize control effort are demonstrated and qualitatively compared with observed behaviors.


title: Parametrization of the surface energy in the ETF approximation

abstract: We perform extended Thomas-Fermi calculations in the Wigner-Seitz cell below and above neutron drip with realistic functionals. The resulting energy density is decomposed as a sum of bulk terms and a surface term, and a compressible liquid drop analytical formula is used to fit the surface tension. The effect of curvature terms and neutron skin is studied in detail. A very good reproduction of the microscopic data is obtained using an expression that depends only on the mass and charge of the cluster, showing that the in-medium modifications of the nuclear energy in the presence of an external neutron gas can be effectively accounted for in the isospin dependence of the surface tension. In this first application, aimed at establishing the fitting protocol, we concentrate on the Sly4 energy functional, but the study can be easily generalized to different functionals, and the resulting parametrizations can be used for direct applications in pasta calculations in neutron star crusts and supernova matter.


title: The Szemer\'edi-Petruska conjecture for a few small values

abstract: Let H be a 3-uniform hypergraph of order n with clique number k such that the intersection of all maximum cliques of H is empty. For fixed m=n-k, Szemer\'edi and Petruska conjectured the sharp bound $n\leq {m+2\choose 2}$. In this note the conjecture is verified for m=2,3 and 4.


title: Random Access with Layered Preambles based on NOMA for Two Different Types of Devices in MTC

abstract: In machine-type communication (MTC), random access has been employed for a number of devices and sensors to access uplink channels using a pool of preambles. To support different priorities due to various quality-of-service (QoS) requirements, random access can be generalized with multiple pools, which may result in low spectral efficiency. In this paper, for high spectral efficiency, random access with layered preambles (RALP) is proposed to support devices with two different priorities based on the notion of power-domain non-orthogonal multiple access (NOMA). In RALP, two groups of devices, namely type-1 and type-2 devices, are supported with different priorities, where type-1 devices have higher priority than type-2 devices. Closed-form expressions are derived for the detection performance of preambles transmitted by type-1 devices, which can be used for a certain performance guarantee of type-1 devices of high priority. Low-complexity preamble detection methods are also discussed.


title: Nemchinov-Dyson Solutions of the Two-Dimensional Axisymmetric Inviscid Compressible Flow Equations

abstract: We investigate the two-dimensional ($2$D) inviscid compressible flow equations in axisymmetric coordinates, constrained by an ideal gas equation of state (EOS). Beginning with the assumption that the $2$D velocity field is space-time separable and linearly variable in each corresponding spatial coordinate, we proceed to derive an infinite family of elliptic or hyperbolic, uniformly expanding or contracting ``gas cloud'' solutions. Construction of specific example solutions belonging to this family is dependent on the solution of a system of nonlinear, coupled, second-order ordinary differential equations, and the prescription of an additional physical process of interest (e.g., uniform temperature or uniform entropy flow). The physical and computational implications of these solutions as pertaining to quantitative code verification or model qualification studies are discussed in some detail.


title: Stuttering Speech Disfluency Prediction using Explainable Attribution Vectors of Facial Muscle Movements

abstract: Speech disorders such as stuttering disrupt the normal fluency of speech by involuntary repetitions, prolongations and blocking of sounds and syllables. In addition to these disruptions to speech fluency, most adults who stutter (AWS) also experience numerous observable secondary behaviors before, during, and after a stuttering moment, often involving the facial muscles. Recent studies have explored automatic detection of stuttering using Artificial Intelligence (AI) based algorithm from respiratory rate, audio, etc. during speech utterance. However, most methods require controlled environments and/or invasive wearable sensors, and are unable explain why a decision (fluent vs stuttered) was made. We hypothesize that pre-speech facial activity in AWS, which can be captured non-invasively, contains enough information to accurately classify the upcoming utterance as either fluent or stuttered. Towards this end, this paper proposes a novel explainable AI (XAI) assisted convolutional neural network (CNN) classifier to predict near future stuttering by learning temporal facial muscle movement patterns of AWS and explains the important facial muscles and actions involved. Statistical analyses reveal significantly high prevalence of cheek muscles (p<0.005) and lip muscles (p<0.005) to predict stuttering and shows a behavior conducive of arousal and anticipation to speak. The temporal study of these upper and lower facial muscles may facilitate early detection of stuttering, promote automated assessment of stuttering and have application in behavioral therapies by providing automatic non-invasive feedback in realtime.


title: Peak thermoelectric power factor of holey silicon films

abstract: The thermoelectric properties of nanostructured silicon are not fully understood despite their initial promise. While the anomalously low thermal conductivity has attracted much work, the impact of nanostructuring on the power factor has mostly escaped attention. While initial reports did not find any significant changes to the power factor compared to the bulk, subsequent detailed measurements on p-type silicon nanowires showed a stark reduction in the Seebeck coefficient when compared to similarly doped bulk. The reduction is consistent with the disappearance of the phonon drag contribution, due to phonon boundary scattering. Here, we report measurements on a different nanostructure, holey silicon films, to test if similar loss of phonon drag can be observed. By devising experiments where all properties are measured on the same sample, we show that though these films possess electrical conductivity close to that in the bulk at comparable doping, they exhibit considerably smaller thermopower. The data are consistent with loss of phonon drag. At neck distances between 120 - 230 nm, the power factor at optimal doping is $\sim$ 50 percent that of the bulk. These insights are useful in the practical design of future thermoelectric devices based on nanostructured silicon.


title: Modulated longitudinal gates on encoded spin-qubits via curvature couplings to a superconducting cavity

abstract: We propose entangling operations based on the energy curvature couplings of encoded spin qubits to a superconducting cavity, exploring the non-linear qubit response to a gate voltage variation. For a two-qubit ($n$-qubit) entangling gate we explore acquired geometric phases via a time-modulated longitudinal $\sigma_z$-coupling, offering gate times of 10s of ns even when the qubits and the cavity are far detuned. No dipole moment is necessary: the qubit transverse $\sigma_x$-coupling to the resonator is zero at the full sweet spot of the encoded spin qubit of interest (a triple quantum dot three-electron exchange-only qubit or a double quantum dot singlet-triplet qubit). This approach allows always-on, exchange-only qubits, for example, to stay on their "sweet spots" during gate operations, minimizing the charge noise and eliminating an always-on static longitudinal qubit-qubit coupling. We calculate the main gate errors due to the (1) diffusion (Johnson) noise and (2) damping of the resonator, the (3) $1/f$-charge noise qubit gate dephasing and $1/f$-noise on the longitudinal coupling, (4) qubit dephasing and ac-Stark frequency shifts via photon fluctuations in the resonator, and (5) spin-dependent resonator frequency shifts (via a "dispersive-like" static curvature coupling), most of them associated with the non-zero qubit energy curvature (quantum capacitance). Using spin-echo-like error suppression at optimal regimes, gate infidelities of $10^{-2}-10^{-3}$ can be achieved with experimentally existing parameters. The proposed schemes seem suitable for remote spin-to-spin entanglement of two spin-qubits or a cluster of spin-qubits: an important resource of quantum computing.


title: Utility-efficient Differentially Private K-means Clustering based on Cluster Merging

abstract: Differential privacy is widely used in data analysis. State-of-the-art $k$-means clustering algorithms with differential privacy typically add an equal amount of noise to centroids for each iterative computation. In this paper, we propose a novel differentially private $k$-means clustering algorithm, DP-KCCM, that significantly improves the utility of clustering by adding adaptive noise and merging clusters. Specifically, to obtain $k$ clusters with differential privacy, the algorithm first generates $n \times k$ initial centroids, adds adaptive noise for each iteration to get $n \times k$ clusters, and finally merges these clusters into $k$ ones. We theoretically prove the differential privacy of the proposed algorithm. Surprisingly, extensive experimental results show that: 1) cluster merging with equal amounts of noise improves the utility somewhat; 2) although adding adaptive noise only does not improve the utility, combining both cluster merging and adaptive noise further improves the utility significantly.


title: DCDChain: A Credible Architecture of Digital Copyright Detection Based on Blockchain

abstract: Copyright detection is an effective method to prevent piracy. However, untrustworthy detection parties may lead to falsified detection results. Due to its credibility and tamper resistance, blockchain has been applied to copyright protection. Previous works mainly utilized blockchain for reliable copyright information storage or copyrighted digital media trading. As far as we know, the problem of credible copyright detection has not been addressed. In this paper, we propose a credible copyright detection architecture based on the blockchain, called DCDChain. In this architecture, the detection agency first detects copyrights off the chain, then uploads the detection records to the blockchain. Since data on the blockchain are publicly accessible, media providers can verify the correctness of the copyright detection, and appeal to a smart contract if there is any dissent. The smart contract then arbitrates the disputes by verifying the correctness of detection on the chain. The detect-verify-and-arbitrate mechanism guarantees the credibility of copyright detection. Security analysis and experimental simulations show that the digital copyright detection architecture is credible, secure and efficient. The proposed credible copyright detection scheme is highly important for copyright protection. The future work is to improve the scheme by designing more effective locality sensitive hash algorithms for various digital media.


title: Placement of UAV-Mounted Mobile Base Station through User Load-Feature K-means Clustering

abstract: Temporary high traffic requests in cellular networks is a challenging problem to address. Recent advances in Unmanned Aerial Vehicles applied to cover these types of traffics. UAV -Mounted Mobile Base Stations placement is a challenging problem to achieve high performance. Different approaches have been proposed; however, user required traffic is not considered in UAV placement. We propose a new feature to apply to K-means clustering to find the optimum clusters. User required traffic is defined as a new feature to assign users to the UAVs. Our simulation results show that UAVs could be placed closer to the high traffic users to achieve higher performance.


title: Structure and cohomology of 3-Lie-Rinehart superalgebras

abstract: We introduce the concept of 3-Lie-Rinehart superalgebra and systematically describe a cohomology complex by considering coefficient modules. Furthermore, we study the relationships between a Lie-Rinehart superalgebra and its induced 3-Lie-Rinehart superalgebra. The deformations of 3-Lie-Rinehart superalgebra are considered via the cohomology theory.


title: A Deep Genetic Programming based Methodology for Art Media Classification Robust to Adversarial Perturbations

abstract: Art Media Classification problem is a current research area that has attracted attention due to the complex extraction and analysis of features of high-value art pieces. The perception of the attributes can not be subjective, as humans sometimes follow a biased interpretation of artworks while ensuring automated observation's trustworthiness. Machine Learning has outperformed many areas through its learning process of artificial feature extraction from images instead of designing handcrafted feature detectors. However, a major concern related to its reliability has brought attention because, with small perturbations made intentionally in the input image (adversarial attack), its prediction can be completely changed. In this manner, we foresee two ways of approaching the situation: (1) solve the problem of adversarial attacks in current neural networks methodologies, or (2) propose a different approach that can challenge deep learning without the effects of adversarial attacks. The first one has not been solved yet, and adversarial attacks have become even more complex to defend. Therefore, this work presents a Deep Genetic Programming method, called Brain Programming, that competes with deep learning and studies the transferability of adversarial attacks using two artworks databases made by art experts. The results show that the Brain Programming method preserves its performance in comparison with AlexNet, making it robust to these perturbations and competing to the performance of Deep Learning.


title: Mining Knowledge for Natural Language Inference from Wikipedia Categories

abstract: Accurate lexical entailment (LE) and natural language inference (NLI) often require large quantities of costly annotations. To alleviate the need for labeled data, we introduce WikiNLI: a resource for improving model performance on NLI and LE tasks. It contains 428,899 pairs of phrases constructed from naturally annotated category hierarchies in Wikipedia. We show that we can improve strong baselines such as BERT and RoBERTa by pretraining them on WikiNLI and transferring the models on downstream tasks. We conduct systematic comparisons with phrases extracted from other knowledge bases such as WordNet and Wikidata to find that pretraining on WikiNLI gives the best performance. In addition, we construct WikiNLI in other languages, and show that pretraining on them improves performance on NLI tasks of corresponding languages.


title: Proving Quantum Programs Correct

abstract: As quantum computing progresses steadily from theory into practice, programmers will face a common problem: How can they be sure that their code does what they intend it to do? This paper presents encouraging results in the application of mechanized proof to the domain of quantum programming in the context of the SQIR development. It verifies the correctness of a range of a quantum algorithms including Grover's algorithm and quantum phase estimation, a key component of Shor's algorithm. In doing so, it aims to highlight both the successes and challenges of formal verification in the quantum context and motivate the theorem proving community to target quantum computing as an application domain.


title: Deep Learning for Digital Asset Limit Order Books

abstract: This paper shows that temporal CNNs accurately predict bitcoin spot price movements from limit order book data. On a 2 second prediction time horizon we achieve 71\% walk-forward accuracy on the popular cryptocurrency exchange coinbase. Our model can be trained in less than a day on commodity GPUs which could be installed into colocation centers allowing for model sync with existing faster orderbook prediction models. We provide source code and data at https://github.com/Globe-Research/deep-orderbook.


title: Improving Network Slimming with Nonconvex Regularization

abstract: Convolutional neural networks (CNNs) have developed to become powerful models for various computer vision tasks ranging from object detection to semantic segmentation. However, most of the state-of-the-art CNNs cannot be deployed directly on edge devices such as smartphones and drones, which need low latency under limited power and memory bandwidth. One popular, straightforward approach to compressing CNNs is network slimming, which imposes $\ell_1$ regularization on the channel-associated scaling factors via the batch normalization layers during training. Network slimming thereby identifies insignificant channels that can be pruned for inference. In this paper, we propose replacing the $\ell_1$ penalty with an alternative nonconvex, sparsity-inducing penalty in order to yield a more compressed and/or accurate CNN architecture. We investigate $\ell_p (0 < p < 1)$, transformed $\ell_1$ (T$\ell_1$), minimax concave penalty (MCP), and smoothly clipped absolute deviation (SCAD) due to their recent successes and popularity in solving sparse optimization problems, such as compressed sensing and variable selection. We demonstrate the effectiveness of network slimming with nonconvex penalties on three neural network architectures -- VGG-19, DenseNet-40, and ResNet-164 -- on standard image classification datasets. Based on the numerical experiments, T$\ell_1$ preserves model accuracy against channel pruning, $\ell_{1/2, 3/4}$ yield better compressed models with similar accuracies after retraining as $\ell_1$, and MCP and SCAD provide more accurate models after retraining with similar compression as $\ell_1$. Network slimming with T$\ell_1$ regularization also outperforms the latest Bayesian modification of network slimming in compressing a CNN architecture in terms of memory storage while preserving its model accuracy after channel pruning.


title: Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategies

abstract: Federated learning is a distributed optimization paradigm that enables a large number of resource-limited client nodes to cooperatively train a model without data sharing. Several works have analyzed the convergence of federated learning by accounting of data heterogeneity, communication and computation limitations, and partial client participation. However, they assume unbiased client participation, where clients are selected at random or in proportion of their data sizes. In this paper, we present the first convergence analysis of federated optimization for biased client selection strategies, and quantify how the selection bias affects convergence speed. We reveal that biasing client selection towards clients with higher local loss achieves faster error convergence. Using this insight, we propose Power-of-Choice, a communication- and computation-efficient client selection framework that can flexibly span the trade-off between convergence speed and solution bias. Our experiments demonstrate that Power-of-Choice strategies converge up to 3 $\times$ faster and give $10$% higher test accuracy than the baseline random selection.


title: Semi-wave, traveling wave and spreading speed for monostable cooperative systems with nonlocal diffusion and free boundaries

abstract: We consider a class of cooperative reaction-diffusion systems with free boundaries in one space dimension, where the diffusion terms are nonlocal, given by integral operators involving suitable kernel functions, and they are allowed not to appear in some of the equations in the system. The problem is monostable in nature, resembling the well known Fisher-KPP equation. Such a system covers various models arising from mathematical biology, with the Fisher-KPP equation as the simplest special case, where a "spreading-vanishing" dichotomy is known to govern the long time dynamical behaviour. The question of spreading speed is widely open for such systems except for the scalar case. In this paper, we develop a systematic approach to determine the spreading profile of the system, and obtain threshold conditions on the kernel functions which decide exactly when the spreading has finite speed, or infinite speed (accelerated spreading). This relies on a rather complete understanding of both the associated semi-waves and traveling waves. When the spreading speed is finite, we show that the speed is determined by a particular semi-wave, and obtain sharp estimates of the semi-wave profile and the spreading speed. For kernel functions that behave like $|x|^{-\gamma}$ near infinity, we are able to obtain better estimates of the spreading speed for both the finite speed case, and the infinite speed case, which appear to be the first for this kind of free boundary problems, even for the special Fisher-KPP equation.


title: Consensus Clustering With Unsupervised Representation Learning

abstract: Recent advances in deep clustering and unsupervised representation learning are based on the idea that different views of an input image (generated through data augmentation techniques) must either be closer in the representation space, or have a similar cluster assignment. Bootstrap Your Own Latent (BYOL) is one such representation learning algorithm that has achieved state-of-the-art results in self-supervised image classification on ImageNet under the linear evaluation protocol. However, the utility of the learnt features of BYOL to perform clustering is not explored. In this work, we study the clustering ability of BYOL and observe that features learnt using BYOL may not be optimal for clustering. We propose a novel consensus clustering based loss function, and train BYOL with the proposed loss in an end-to-end way that improves the clustering ability and outperforms similar clustering based methods on some popular computer vision datasets.


title: 3D-Aided Data Augmentation for Robust Face Understanding

abstract: Data augmentation has been highly effective in narrowing the data gap and reducing the cost for human annotation, especially for tasks where ground truth labels are difficult and expensive to acquire. In face recognition, large pose and illumination variation of face images has been a key factor for performance degradation. However, human annotation for the various face understanding tasks including face landmark localization, face attributes classification and face recognition under these challenging scenarios are highly costly to acquire. Therefore, it would be desirable to perform data augmentation for these cases. But simple 2D data augmentation techniques on the image domain are not able to satisfy the requirement of these challenging cases. As such, 3D face modeling, in particular, single image 3D face modeling, stands a feasible solution for these challenging conditions beyond 2D based data augmentation. To this end, we propose a method that produces realistic 3D augmented images from multiple viewpoints with different illumination conditions through 3D face modeling, each associated with geometrically accurate face landmarks, attributes and identity information. Experiments demonstrate that the proposed 3D data augmentation method significantly improves the performance and robustness of various face understanding tasks while achieving state-of-arts on multiple benchmarks.


title: Interpreting Robust Optimization via Adversarial Influence Functions

abstract: Robust optimization has been widely used in nowadays data science, especially in adversarial training. However, little research has been done to quantify how robust optimization changes the optimizers and the prediction losses comparing to standard training. In this paper, inspired by the influence function in robust statistics, we introduce the Adversarial Influence Function (AIF) as a tool to investigate the solution produced by robust optimization. The proposed AIF enjoys a closed-form and can be calculated efficiently. To illustrate the usage of AIF, we apply it to study model sensitivity -- a quantity defined to capture the change of prediction losses on the natural data after implementing robust optimization. We use AIF to analyze how model complexity and randomized smoothing affect the model sensitivity with respect to specific models. We further derive AIF for kernel regressions, with a particular application to neural tangent kernels, and experimentally demonstrate the effectiveness of the proposed AIF. Lastly, the theories of AIF will be extended to distributional robust optimization.


title: Superconvergence and regularity of densities in free probability

abstract: The superconvergence phenomenon is shown for products of free, identically distributed random variables. We also show that a certain Holder regularity, first demonstrated by Biane for the density of a free additive convolution with a semicircular law, extends to free additive and multiplicative convolutions with arbitrary freely infinitely divisible laws and to free convolution semigroups.


title: Optimal Echo Chambers

abstract: When learning from others, people tend to focus their attention on those with similar views. This is often attributed to flawed reasoning, and thought to slow learning and polarize beliefs. However, we show that echo chambers are a rational response to uncertainty about the accuracy of information sources, and can improve learning and reduce disagreement. Furthermore, overextending the range of views someone is exposed to can backfire, slowing their learning by making them less responsive to information from others. We model a Bayesian decision maker who chooses a set of information sources and then observes a signal from one. With uncertainty about which sources are accurate, focusing attention on signals close to one's own expectation can be beneficial, as their expected accuracy is higher. The optimal echo chamber balances the credibility of views similar to one's own against the usefulness of those further away.


title: CorrAttack: Black-box Adversarial Attack with Structured Search

abstract: We present a new method for score-based adversarial attack, where the attacker queries the loss-oracle of the target model. Our method employs a parameterized search space with a structure that captures the relationship of the gradient of the loss function. We show that searching over the structured space can be approximated by a time-varying contextual bandits problem, where the attacker takes feature of the associated arm to make modifications of the input, and receives an immediate reward as the reduction of the loss function. The time-varying contextual bandits problem can then be solved by a Bayesian optimization procedure, which can take advantage of the features of the structured action space. The experiments on ImageNet and the Google Cloud Vision API demonstrate that the proposed method achieves the state of the art success rates and query efficiencies for both undefended and defended models.


title: UCP: Uniform Channel Pruning for Deep Convolutional Neural Networks Compression and Acceleration

abstract: To apply deep CNNs to mobile terminals and portable devices, many scholars have recently worked on the compressing and accelerating deep convolutional neural networks. Based on this, we propose a novel uniform channel pruning (UCP) method to prune deep CNN, and the modified squeeze-and-excitation blocks (MSEB) is used to measure the importance of the channels in the convolutional layers. The unimportant channels, including convolutional kernels related to them, are pruned directly, which greatly reduces the storage cost and the number of calculations. There are two types of residual blocks in ResNet. For ResNet with bottlenecks, we use the pruning method with traditional CNN to trim the 3x3 convolutional layer in the middle of the blocks. For ResNet with basic residual blocks, we propose an approach to consistently prune all residual blocks in the same stage to ensure that the compact network structure is dimensionally correct. Considering that the network loses considerable information after pruning and that the larger the pruning amplitude is, the more information that will be lost, we do not choose fine-tuning but retrain from scratch to restore the accuracy of the network after pruning. Finally, we verified our method on CIFAR-10, CIFAR-100 and ILSVRC-2012 for image classification. The results indicate that the performance of the compact network after retraining from scratch, when the pruning rate is small, is better than the original network. Even when the pruning amplitude is large, the accuracy can be maintained or decreased slightly. On the CIFAR-100, when reducing the parameters and FLOPs up to 82% and 62% respectively, the accuracy of VGG-19 even improved by 0.54% after retraining.


title: Dynamical Crystallites of Active Chiral Particles

abstract: One of the intrinsic characteristics of far-from-equilibrium systems is the nonrelaxational nature of the system dynamics, which leads to novel properties that cannot be understood and described by conventional pathways based on thermodynamic potentials. Of particular interest are the formation and evolution of ordered patterns composed of active particles that exhibit collective behavior. Here we examine such a type of nonpotential active system, focusing on effects of coupling and competition between chiral particle self-propulsion and self-spinning. It leads to the transition between three bulk dynamical regimes dominated by collective translative motion, spinning-induced structural arrest, and dynamical frustration. In addition, a persistently dynamical state of self-rotating crystallites is identified as a result of a localized-delocalized transition induced by the crystal-melt interface. The mechanism for the breaking of localized bulk states can also be utilized to achieve self-shearing or self-flow of active crystalline layers.


title: Towards fully non-perturbative computation of inelastic $\ell N$ scattering cross sections from lattice QCD

abstract: We propose a fully non-perturbative method to compute inelastic lepton-nucleon ($\ell N$) scattering cross sections using lattice QCD. The method is applicable even at low energies, such as the energy region relevant for the recent and future neutrino-nucleon ($\nu N$) scattering experiments, for which perturbative analysis is invalidated. The basic building block is the forward Compton-scattering amplitude, or the hadronic tensor, computed on a Euclidean lattice. Total cross section is constructed from the hadronic tensor by multiplying a phase space factor and integrating over the energy and momentum of final hadronic states. The energy integral that induces a sum over all possible final states is performed implicitly by promoting the phase space factor to an operator written in terms of the transfer matrix on the lattice. The formalism is imported from that of the inclusive semileptonic B meson decay [P. Gambino, S. Hashimoto, arXiv:2005.13730]. It can be generalized to compute the $\ell N$ scattering cross sections and their moments, as well as the virtual correction to the nuclear $\beta$-decay. Necessary quark-line contractions for two current insertions corresponding to the Compton amplitude to be computed on the lattice are summarized.


title: High-Temperature Ultra-Broad UV-MIR High-Efficiency Absorber Based on Double Ring-Shaped Titanium Nitride Resonators

abstract: An ultrabroad absorber based on double-ring-shaped titanium nitride (TiN) nanoresonators, which can work in high temperatures, is proposed and numerically studied. The absorber with some optimal parameters exhibits an averaged absorption of 94.6% in the range of 200 - 4000 nm (from ultraviolet to mid-infrared) and a band from 200 - 3518 nm having an absorption > 90%. We have demonstrated in detail the physical mechanisms of the ultra-broad absorption, including the dielectric lossy property of TiN material itself in shorter wavelengths and plasmonic resonances caused by the metallic property of TiN nano-resonators in longer wavelengths. In addition, the absorber shows polarization independent and wide-angle acceptance. Another absorber with double TiN nano-rings of different heights has flatter and higher absorption efficiency (more than 95% absorption) at 200-2860 nm waveband. These properties make the proposed absorbers based on TiN has great potentials in many applications, such as light trapping, photovoltaics, thermal emitters.


title: Attractor Selection in Nonlinear Energy Harvesting Using Deep Reinforcement Learning

abstract: Recent research efforts demonstrate that the intentional use of nonlinearity enhances the capabilities of energy harvesting systems. One of the primary challenges that arise in nonlinear harvesters is that nonlinearities can often result in multiple attractors with both desirable and undesirable responses that may co-exist. This paper presents a nonlinear energy harvester which is based on translation-to-rotational magnetic transmission and exhibits coexisting attractors with different levels of electric power output. In addition, a control method using deep reinforcement learning was proposed to realize attractor switching between coexisting attractors with constrained actuation.


title: Cartographic Relief Shading with Neural Networks

abstract: Shaded relief is an effective method for visualising terrain on topographic maps, especially when the direction of illumination is adapted locally to emphasise individual terrain features. However, digital shading algorithms are unable to fully match the expressiveness of hand-crafted masterpieces, which are created through a laborious process by highly specialised cartographers. We replicate hand-drawn relief shading using U-Net neural networks. The deep neural networks are trained with manual shaded relief images of the Swiss topographic map series and terrain models of the same area. The networks generate shaded relief that closely resemble hand-drawn shaded relief art. The networks learn essential design principles from manual relief shading such as removing unnecessary terrain details, locally adjusting the illumination direction to accentuate individual terrain features, and varying brightness to emphasise larger landforms. Neural network shadings are generated from digital elevation models in a few seconds, and a study with 18 relief shading experts found that they are of high quality.


title: On the Value of Energy Storage in Generation Cost Reduction

abstract: This work seeks to quantify the benefits of using energy storage toward the reduction of the energy generation cost of a power system. A two-fold optimization framework is provided where the first optimization problem seeks to find the optimal storage schedule that minimizes operational costs. Since the operational cost depends on the storage capacity, a second optimization problem is then formulated with the aim of finding the optimal storage capacity to be deployed. Although, in general, these problems are difficult to solve, we provide a lower bound on the cost savings for a parametrized family of demand profiles. The optimization framework is numerically illustrated using real-world demand data from ISO New England. Numerical results show that energy storage can reduce energy generation costs by at least 2.5 %.


title: Hit ratio: An Evaluation Metric for Hashtag Recommendation

abstract: Hashtag recommendation is a crucial task, especially with an increase of interest in using social media platforms such as Twitter in the last decade. Hashtag recommendation systems automatically suggest hashtags to a user while writing a tweet. Most of the research in the area of hashtag recommendation have used classical metrics such as hit rate, precision, recall, and F1-score to measure the accuracy of hashtag recommendation systems. These metrics are based on the exact match of the recommended hashtags with their corresponding ground truth. However, it is not clear how adequate these metrics to evaluate hashtag recommendation. The research question that we are interested in seeking an answer is: are these metrics adequate for evaluating hashtag recommendation systems when the numbers of ground truth hashtags in tweets are highly variable? In this paper, we propose a new metric which we call hit ratio for hashtag recommendation. Extensive evaluation through hypothetical examples and real-world application across a range of hashtag recommendation models indicate that the hit ratio is a useful metric. A comparison of hit ratio with the classical evaluation metrics reveals their limitations.


title: The logarithmic mean of two convex functionals

abstract: The purpose of this paper is to introduce the logarithmic mean of two convex functionals that extends the logarithmic mean of two positive operators. Some inequalities involving this functional mean are discussed as well. The operator versions of the functional theoretical results obtained here are immediately deduced without referring to the theory of operator means.


title: Global analysis of more than 50,000 SARS-Cov-2 genomes reveals epistasis between 8 viral genes

abstract: Genome-wide epistasis analysis is a powerful tool to infer gene interactions, which can guide drug and vaccine development and lead to a deeper understanding of microbial pathogenesis. We have considered all complete SARS-CoV-2 genomes deposited in the GISAID repository until \textbf{four} different cut-off dates, and used Direct Coupling Analysis together with an assumption of Quasi-Linkage Equilibrium to infer epistatic contributions to fitness from polymorphic loci. We find \textbf{eight} interactions, of which three between pairs where one locus lies in gene ORF3a, both loci holding non-synonymous mutations. We also find interactions between two loci in gene nsp13, both holding non-synonymous mutations, and four interactions involving one locus holding a synonymous mutation. Altogether we infer interactions between loci in viral genes ORF3a and nsp2, nsp12 and nsp6, between ORF8 and nsp4, and between loci in genes nsp2, nsp13 and nsp14. The paper opens the prospect to use prominent epistatically linked pairs as a starting point to search for combinatorial weaknesses of recombinant viral pathogens.


title: Spectrum of Heavy-Tailed Elliptic Random Matrices

abstract: An elliptic random matrix $X$ is a square matrix whose $(i,j)$-entry $X_{ij}$ is independent of the rest of the entries except possibly $X_{ji}$. Elliptic random matrices generalize Wigner matrices and non-Hermitian random matrices with independent entries. When the entries of an elliptic random matrix have mean zero and unit variance, the empirical spectral distribution is known to converge to the uniform distribution on the interior of an ellipse determined by the covariance of the mirrored entries. We consider elliptic random matrices whose entries fail to have two finite moments. Our main result shows that when the entries of an elliptic random matrix are in the domain of attraction of an $\alpha$-stable random variable, for $0<\alpha<2$, the empirical spectral measure converges, in probability, to a deterministic limit. This generalizes a result of Bordenave, Caputo, and Chafa\"i for heavy-tailed matrices with independent and identically distributed entries. The key elements of the proof are (i) a general bound on the least singular value of elliptic random matrices under no moment assumptions; and (ii) the convergence, in an appropriate sense, of the matrices to a random operator on the Poisson Weighted Infinite Tree.


title: Integrating Categorical Semantics into Unsupervised Domain Translation

abstract: While unsupervised domain translation (UDT) has seen a lot of success recently, we argue that mediating its translation via categorical semantic features could broaden its applicability. In particular, we demonstrate that categorical semantics improves the translation between perceptually different domains sharing multiple object categories. We propose a method to learn, in an unsupervised manner, categorical semantic features (such as object labels) that are invariant of the source and target domains. We show that conditioning the style encoder of unsupervised domain translation methods on the learned categorical semantics leads to a translation preserving the digits on MNIST$\leftrightarrow$SVHN and to a more realistic stylization on Sketches$\to$Reals.


title: Multilevel Text Alignment with Cross-Document Attention

abstract: Text alignment finds application in tasks such as citation recommendation and plagiarism detection. Existing alignment methods operate at a single, predefined level and cannot learn to align texts at, for example, sentence and document levels. We propose a new learning approach that equips previously established hierarchical attention encoders for representing documents with a cross-document attention component, enabling structural comparisons across different levels (document-to-document and sentence-to-document). Our component is weakly supervised from document pairs and can align at multiple levels. Our evaluation on predicting document-to-document relationships and sentence-to-document relationships on the tasks of citation recommendation and plagiarism detection shows that our approach outperforms previously established hierarchical, attention encoders based on recurrent and transformer contextualization that are unaware of structural correspondence between documents.


title: HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients

abstract: Federated Learning (FL) is a method of training machine learning models on private data distributed over a large number of possibly heterogeneous clients such as mobile phones and IoT devices. In this work, we propose a new federated learning framework named HeteroFL to address heterogeneous clients equipped with very different computation and communication capabilities. Our solution can enable the training of heterogeneous local models with varying computation complexities and still produce a single global inference model. For the first time, our method challenges the underlying assumption of existing work that local models have to share the same architecture as the global model. We demonstrate several strategies to enhance FL training and conduct extensive empirical evaluations, including five computation complexity levels of three model architecture on three datasets. We show that adaptively distributing subnetworks according to clients' capabilities is both computation and communication efficient.


title: DoubleEnsemble: A New Ensemble Method Based on Sample Reweighting and Feature Selection for Financial Data Analysis

abstract: Modern machine learning models (such as deep neural networks and boosting decision tree models) have become increasingly popular in financial market prediction, due to their superior capacity to extract complex non-linear patterns. However, since financial datasets have very low signal-to-noise ratio and are non-stationary, complex models are often very prone to overfitting and suffer from instability issues. Moreover, as various machine learning and data mining tools become more widely used in quantitative trading, many trading firms have been producing an increasing number of features (aka factors). Therefore, how to automatically select effective features becomes an imminent problem. To address these issues, we propose DoubleEnsemble, an ensemble framework leveraging learning trajectory based sample reweighting and shuffling based feature selection. Specifically, we identify the key samples based on the training dynamics on each sample and elicit key features based on the ablation impact of each feature via shuffling. Our model is applicable to a wide range of base models, capable of extracting complex patterns, while mitigating the overfitting and instability issues for financial market prediction. We conduct extensive experiments, including price prediction for cryptocurrencies and stock trading, using both DNN and gradient boosting decision tree as base models. Our experiment results demonstrate that DoubleEnsemble achieves a superior performance compared with several baseline methods.


title: Hydrodynamic limit of the Kawasaki dynamics on the 1D-lattice with strong, finite-range interaction

abstract: We derive the hydrodynamic limit of the Kawasaki dynamics for the one-dimensional conservative system of unbounded real-valued spins with arbitrary strong, quadratic and finite-range interactions. This extends prior results for non-interacting spin systems. The result is obtained by adapting two scale approach of Grunewald, Otto, Villani and Westdickenberg combined with the authors' recent approach on conservative systems with strong interactions.


title: WeMix: How to Better Utilize Data Augmentation

abstract: Data augmentation is a widely used training trick in deep learning to improve the network generalization ability. Despite many encouraging results, several recent studies did point out limitations of the conventional data augmentation scheme in certain scenarios, calling for a better theoretical understanding of data augmentation. In this work, we develop a comprehensive analysis that reveals pros and cons of data augmentation. The main limitation of data augmentation arises from the data bias, i.e. the augmented data distribution can be quite different from the original one. This data bias leads to a suboptimal performance of existing data augmentation methods. To this end, we develop two novel algorithms, termed "AugDrop" and "MixLoss", to correct the data bias in the data augmentation. Our theoretical analysis shows that both algorithms are guaranteed to improve the effect of data augmentation through the bias correction, which is further validated by our empirical studies. Finally, we propose a generic algorithm "WeMix" by combining AugDrop and MixLoss, whose effectiveness is observed from extensive empirical evaluations.


title: Partially-Aligned Data-to-Text Generation with Distant Supervision

abstract: The Data-to-Text task aims to generate human-readable text for describing some given structured data enabling more interpretability. However, the typical generation task is confined to a few particular domains since it requires well-aligned data which is difficult and expensive to obtain. Using partially-aligned data is an alternative way of solving the dataset scarcity problem. This kind of data is much easier to obtain since it can be produced automatically. However, using this kind of data induces the over-generation problem posing difficulties for existing models, which tends to add unrelated excerpts during the generation procedure. In order to effectively utilize automatically annotated partially-aligned datasets, we extend the traditional generation task to a refined task called Partially-Aligned Data-to-Text Generation (PADTG) which is more practical since it utilizes automatically annotated data for training and thus considerably expands the application domains. To tackle this new task, we propose a novel distant supervision generation framework. It firstly estimates the input data's supportiveness for each target word with an estimator and then applies a supportiveness adaptor and a rebalanced beam search to harness the over-generation problem in the training and generation phases respectively. We also contribute a partially-aligned dataset (The data and source code of this paper can be obtained from https://github.com/fuzihaofzh/distant_supervision_nlg by sampling sentences from Wikipedia and automatically extracting corresponding KB triples for each sentence from Wikidata. The experimental results show that our framework outperforms all baseline models as well as verify the feasibility of utilizing partially-aligned data.


title: Segment inequality and almost rigidity structures for integral Ricci curvature

abstract: We will show the Cheeger-Colding segment inequality for manifolds with integral Ricci curvature bound. By using this segment inequality, the almost rigidity structure results for integral Ricci curvature will be derived by a similar method as in \cite{CC1}. And the sharp H\"older continuity result of \cite{CoN} holds in the limit space of manifolds with integral Ricci curvature bound.


title: The negative-parity spin-1/2 $\Lambda$ baryon spectrum from lattice QCD and effective theory

abstract: The spectrum of the negative-parity spin-1/2 $\Lambda$ baryons is studied using lattice QCD and hadronic effective theory in a unitarized coupled-channel framework. A direct comparison between the two approaches is possible by considering the hadronic effective theory in a finite volume and with hadron masses and mesonic decay constants that correspond to the situation studied on the lattice. Comparing the energy level spectrum and $SU(3)$ flavor decompositions of the individual states, it is found that the lowest two states extracted from lattice QCD can be identified with one of the two $\Lambda(1405)$-poles and the $\Lambda(1670)$ resonance. The quark mass dependences of these two lattice QCD levels are in good agreement with their effective theory counterparts. However, as current lattice QCD studies still rely on three-quark operators to generate the physical states, clear signals corresponding to the meson-baryon scattering states, that appear in the finite volume effective theory calculation, are not yet seen.


title: Lateral diffusion on a frozen random surface

abstract: The lateral diffusion coefficient of a Brownian particle on a two-dimensional random surface is studied in the quenched limit for which the surface configuration is time-independent. We start with the stochastic equation of motion for a Brownian particle on a fluctuating surface, which has been derived by Naji and Brown. The mean square displacement of the particle projected on a base plane is calculated exactly under the condition that the surface with a constant shape has no spatial correlation. We prove that the obtained lateral diffusion coefficient is in between the known upper and lower bounds.


title: Towards Interpretable Reasoning over Paragraph Effects in Situation

abstract: We focus on the task of reasoning over paragraph effects in situation, which requires a model to understand the cause and effect described in a background paragraph, and apply the knowledge to a novel situation. Existing works ignore the complicated reasoning process and solve it with a one-step "black box" model. Inspired by human cognitive processes, in this paper we propose a sequential approach for this task which explicitly models each step of the reasoning process with neural network modules. In particular, five reasoning modules are designed and learned in an end-to-end manner, which leads to a more interpretable model. Experimental results on the ROPES dataset demonstrate the effectiveness and explainability of our proposed approach.


title: Substructures in the Disk-Forming Region of the Class 0 Low-Mass Protostellar Source IRAS 16293-2422 Source A on a 10 au Scale

abstract: We have observed the Class 0 protostellar source IRAS 16293-2422 A in the C17O and H2CS lines as well as the 1.3 mm dust continuum with the Atacama Large Millimeter/submillimeter Array at an angular resolution of ~0."1 (14 au). The continuum emission of the binary component, Source A, reveals the substructure consisting of 5 intensity peaks within 100 au from the protostar. The C17O emission mainly traces the circummultiple structure on a 300 au scale centered at the intensity centroid of the continuum, while it is very weak within the radius of 50 au from the centroid. The H2CS emission, in contrast, traces the rotating disk structure around one of the continuum peaks (A1). Thus, it seems that the rotation centroid of the circummultiple structure is slightly different from that of the disk around A1. We derive the rotation temperature by using the multiple lines of H2CS. As approaching to the protostar A1, the rotation temperature steeply rises up to 300 K or higher at the radius of 50 au from the protostar. It is likely due to a local accretion shock and/or the preferential protostellar heating of the transition zone from the circummultiple structure to the disk around A1. This position corresponds to the place where the organic molecular lines are reported to be enhanced. Since the rise of the rotation temperature of H2CS most likely represents the rise of the gas and dust temperatures, it would be related to the chemical characteristics of this prototypical hot corino.


title: Assisting the Adversary to Improve GAN Training

abstract: Some of the most popular methods for improving the stability and performance of GANs involve constraining or regularizing the discriminator. In this paper we consider a largely overlooked regularization technique which we refer to as the Adversary's Assistant (AdvAs). We motivate this using a different perspective to that of prior work. Specifically, we consider a common mismatch between theoretical analysis and practice: analysis often assumes that the discriminator reaches its optimum on each iteration. In practice, this is essentially never true, often leading to poor gradient estimates for the generator. To address this, AdvAs is a theoretically motivated penalty imposed on the generator based on the norm of the gradients used to train the discriminator. This encourages the generator to move towards points where the discriminator is optimal. We demonstrate the effect of applying AdvAs to several GAN objectives, datasets and network architectures. The results indicate a reduction in the mismatch between theory and practice and that AdvAs can lead to improvement of GAN training, as measured by FID scores.


title: Secant Penalized BFGS: A Noise Robust Quasi-Newton Method Via Penalizing The Secant Condition

abstract: In this paper, we introduce a new variant of the BFGS method designed to perform well when gradient measurements are corrupted by noise. We show that by treating the secant condition with a penalty method approach motivated by regularized least squares estimation, one can smoothly interpolate between updating the inverse Hessian approximation with the original BFGS update formula and not updating the inverse Hessian approximation. Furthermore, we find the curvature condition is smoothly relaxed as the interpolation moves towards not updating the inverse Hessian approximation, disappearing entirely when the inverse Hessian approximation is not updated. These developments allow us to develop a method we refer to as secant penalized BFGS (SP-BFGS) that allows one to relax the secant condition based on the amount of noise in the gradient measurements. SP-BFGS provides a means of incrementally updating the new inverse Hessian approximation with a controlled amount of bias towards the previous inverse Hessian approximation, which allows one to replace the overwriting nature of the original BFGS update with an averaging nature that resists the destructive effects of noise and can cope with negative curvature measurements. We discuss the theoretical properties of SP-BFGS, including convergence when minimizing strongly convex functions in the presence of uniformly bounded noise. Finally, we present extensive numerical experiments using over 30 problems from the CUTEst test problem set that demonstrate the superior performance of SP-BFGS compared to BFGS in the presence of both noisy function and gradient evaluations.


title: Theory, preparation, properties and catalysis application in 2D Graphynes-Based Materials

abstract: Carbon has three hybridization forms of sp-, sp2- and sp3-, and the combination of different forms can obtain different kinds of carbon allotropes, such as diamond, carbon nanotubes, fullerene, graphynes (GYs) and graphdiyne (GDY). Among them, the GDY molecule is a single-layer two-dimensional (2D) planar structure material with highly -conjugation formed by sp- and sp2- hybridization. GDY has a carbon atom ring composed of benzene ring and acetylene, which makes GDY have a uniformly distributed pore structure. In addition, GDY planar material have some slight wrinkles, which makes GDY have better self-stability than other 2D planar materials. The excellent properties of GDY make it attract the attention of researcher. Therefore, GDY is widely used in chemical catalysis, electronics, communications, clean energy and composite materials. This paper summarizes the recent progress of GDY research, including structure, preparation, properties and application of GDY in the field of catalysts.


title: A Control Strategy for Capacity Allocation of Hybrid Energy Storage System Based on Hierarchical Processing of Demand Power

abstract: Pursuing optimal power distribution in hybrid energy storage systems has always been the goal of researchers. Here, HESS is a combination of lithium battery and supercapacitor; this combination has been proven to effectively compensate for some of the deficiencies of lithium batteries as an energy system for electric vehicles. For example, the energy storage system with only lithium batteries cannot provide high power in a short time to meet the high acceleration performance of electric vehicles, and the excessive discharge current will cause the temperature of the battery pack to be too high, which will cause safety problems for the car. This paper proposes an intelligent energy management strategy combining fuzzy controller and improved Savitzky-Golay filter for real-time control. The simulation results show that compared with single ESS, the maximum current of the battery proposed by the strategy is reduced by 14.60%, and the usable cycle life of the battery is increased by 57.31% during the test driving cycle. Meanwhile, it explores various changes brought supercapacitor monomers in the same HESS, and predict the next supercapacitor will bring about 31.58% reduction of volume and mass.


title: Efficient Robust Training via Backward Smoothing

abstract: Adversarial training is so far the most effective strategy in defending against adversarial examples. However, it suffers from high computational costs due to the iterative adversarial attacks in each training step. Recent studies show that it is possible to achieve fast Adversarial Training by performing a single-step attack with random initialization. However, such an approach still lags behind state-of-the-art adversarial training algorithms on both stability and model robustness. In this work, we develop a new understanding towards Fast Adversarial Training, by viewing random initialization as performing randomized smoothing for better optimization of the inner maximization problem. Following this new perspective, we also propose a new initialization strategy, backward smoothing, to further improve the stability and model robustness over single-step robust training methods. Experiments on multiple benchmarks demonstrate that our method achieves similar model robustness as the original TRADES method while using much less training time ($\sim$3x improvement with the same training schedule).


title: Do Wider Neural Networks Really Help Adversarial Robustness?

abstract: Adversarial training is a powerful type of defense against adversarial examples. Previous empirical results suggest that adversarial training requires wider networks for better performances. However, it remains elusive how neural network width affects model robustness. In this paper, we carefully examine the relationship between network width and model robustness. Specifically, we show that the model robustness is closely related to the tradeoff between natural accuracy and perturbation stability, which is controlled by the robust regularization parameter $\lambda$. With the same $\lambda$, wider networks can achieve better natural accuracy but worse perturbation stability, leading to a potentially worse overall model robustness. To understand the origin of this phenomenon, we further relate the perturbation stability with the network's local Lipschitzness. By leveraging recent results on neural tangent kernels, we theoretically show that wider networks tend to have worse perturbation stability. Our analyses suggest that: 1) the common strategy of first fine-tuning $\lambda$ on small networks and then directly use it for wide model training could lead to deteriorated model robustness; 2) one needs to properly enlarge $\lambda$ to unleash the robustness potential of wider models fully. Finally, we propose a new Width Adjusted Regularization (WAR) method that adaptively enlarges $\lambda$ on wide models and significantly saves the tuning time.


title: Bayesian Optimized Event Based Epidemic Modeling in India

abstract: Pandemic outbreak creates a life threatening situation around the world and for a while it feels as if it slows down the world. A lot of effort is being taken to mitigate the spread of the pandemics. The main objective of this paper is to build a mathematical model of the pandemic spread in India based on the mass gathering using distribution functions and Bayesian approach. Subsequently modeled the pandemic spread based on the flights arrived in India using generalized linear regression. We validated the effect of these events in the number of confirmed cases in India and formulated the number of confirmed cases in the positive sense. Subsequently, studied the progression of the infective using progression series and flattened the curve using an appropriate convergence criterion. We validated the theoretical aspects with the statistics released by the Government.


title: Constructions using Galois Theory

abstract: We describe algorithms to compute fixed fields, splitting fields and towers of radical extensions without using polynomial factorisation in towers or constructing any field containing the splitting field, instead extending Galois group computations for this task. We also describe the computation of geometric Galois groups (monodromy groups) and their use in computing absolute factorizations.


title: TCLNet: Learning to Locate Typhoon Center Using Deep Neural Network

abstract: The task of typhoon center location plays an important role in typhoon intensity analysis and typhoon path prediction. Conventional typhoon center location algorithms mostly rely on digital image processing and mathematical morphology operation, which achieve limited performance. In this paper, we proposed an efficient fully convolutional end-to-end deep neural network named TCLNet to automatically locate the typhoon center position. We design the network structure carefully so that our TCLNet can achieve remarkable performance base on its lightweight architecture. In addition, we also present a brand new large-scale typhoon center location dataset (TCLD) so that the TCLNet can be trained in a supervised manner. Furthermore, we propose to use a novel TCL+ piecewise loss function to further improve the performance of TCLNet. Extensive experimental results and comparison demonstrate the performance of our model, and our TCLNet achieve a 14.4% increase in accuracy on the basis of a 92.7% reduction in parameters compared with SOTA deep learning based typhoon center location methods.


title: Generating the Cloud Motion Winds Field from Satellite Cloud Imagery Using Deep Learning Approach

abstract: Cloud motion winds (CMW) are routinely derived by tracking features in sequential geostationary satellite infrared cloud imagery. In this paper, we explore the cloud motion winds algorithm based on data-driven deep learning approach, and different from conventional hand-craft feature tracking and correlation matching algorithms, we use deep learning model to automatically learn the motion feature representations and directly output the field of cloud motion winds. In addition, we propose a novel large-scale cloud motion winds dataset (CMWD) for training deep learning models. We also try to use a single cloud imagery to predict the cloud motion winds field in a fixed region, which is impossible to achieve using traditional algorithms. The experimental results demonstrate that our algorithm can predict the cloud motion winds field efficiently, and even with a single cloud imagery as input.


title: Comprehensive Probabilistic Tsunami Hazard Assessment in the Makran Subduction Zone

abstract: After the 2004 and 2011 tsunamis came unprecedented to the scientific community the role of probabilistic tsunami hazard assessment (PTHA) in tsunami-prone areas came to the fore. The Makran subduction zone (MSZ) is a hazardous tsunami-prone region; however, due to its low population density, it is not as prominent in literature. In this study, we assess the threat of tsunami hazard posed to the coast of Iran and Pakistan by the MSZ and present a comprehensive PTHA for the entire coast regardless of population density. We accounted for sources of epistemic uncertainties by employing event tree and ensemble modeling. Aleatory variability was also considered through probability density function. Further, we considered the contribution of small to large magnitudes and used our event trees to create a multitude of scenarios as initial conditions. Funwave-TVD was employed to propagate these scenarios. Our results demonstrate that the spread of hazard curves for different locations on the coast is remarkably large, and the probability that a maximum wave will exceed 3 m somewhere along the coast reaches $\{13.5, 25, 52, 74, 91\}\%$ for return periods $\{50,100, 250, 500, 1000\}$, respectively. Moreover, we found that the exceedance probability could be higher at the west part of Makran for a long return period if we consider it as active as the east part of the MSZ. Finally, we demonstrated that the contribution of aleatory variability is significant, and overlooking it leads to a significant hazard underestimation, particularly for a long return period.


title: Differentially Private Representation for NLP: Formal Guarantee and An Empirical Study on Privacy and Fairness

abstract: It has been demonstrated that hidden representation learned by a deep model can encode private information of the input, hence can be exploited to recover such information with reasonable accuracy. To address this issue, we propose a novel approach called Differentially Private Neural Representation (DPNR) to preserve the privacy of the extracted representation from text. DPNR utilises Differential Privacy (DP) to provide a formal privacy guarantee. Further, we show that masking words via dropout can further enhance privacy. To maintain utility of the learned representation, we integrate DP-noisy representation into a robust training process to derive a robust target model, which also helps for model fairness over various demographic variables. Experimental results on benchmark datasets under various parameter settings demonstrate that DPNR largely reduces privacy leakage without significantly sacrificing the main task performance.


title: Planar projections of graphs

abstract: We introduce and study a new graph representation where vertices are embedded in three or more dimensions, and in which the edges are drawn on the projections onto the axis-parallel planes. We show that the complete graph on $n$ vertices has a representation in $\lceil \sqrt{n/2}+1 \rceil$ planes. In 3 dimensions, we show that there exist graphs with $6n-15$ edges that can be projected onto two orthogonal planes, and that this is best possible. Finally, we obtain bounds in terms of parameters such as geometric thickness and linear arboricity. Using such a bound, we show that every graph of maximum degree 5 has a plane-projectable representation in 3 dimensions.


title: A Block Coordinate Descent Method for Sensor Network Localization

abstract: The problem of sensor network localization (SNL) can be formulated as a semidefinite programming problem with a rank constraint. We propose a new method for solving such SNL problems. We factorize a semidefinite matrix with the rank constraint into a product of two matrices via the Burer--Monteiro factorization. Then, we add the difference of the two matrices, with a penalty parameter, to the objective function, thereby reformulating SNL as an unconstrained multiconvex optimization problem, to which we apply the block coordinate descent method. In this paper, we also provide theoretical analyses of the proposed method and show that each subproblem that is solved sequentially by the block coordinate descent method can also be solved analytically, with the sequence generated by our proposed algorithm converging to a stationary point of the objective function. We also give a range of the penalty parameter for which the two matrices used in the factorization agree at any accumulation point. Numerical experiments confirm that the proposed method does inherit the rank constraint and that it estimates sensor positions faster than other methods without sacrificing the estimation accuracy, especially when the measured distances contain errors.


title: UNISON: Unpaired Cross-lingual Image Captioning

abstract: Image captioning has emerged as an interesting research field in recent years due to its broad application scenarios. The traditional paradigm of image captioning relies on paired image-caption datasets to train the model in a supervised manner. However, creating such paired datasets for every target language is prohibitively expensive, which hinders the extensibility of captioning technology and deprives a large part of the world population of its benefit. In this work, we present a novel unpaired cross-lingual method to generate image captions without relying on any caption corpus in the source or the target language. Specifically, our method consists of two phases: (i) a cross-lingual auto-encoding process, which utilizing a sentence parallel (bitext) corpus to learn the mapping from the source to the target language in the scene graph encoding space and decode sentences in the target language, and (ii) a cross-modal unsupervised feature mapping, which seeks to map the encoded scene graph features from image modality to language modality. We verify the effectiveness of our proposed method on the Chinese image caption generation task. The comparisons against several existing methods demonstrate the effectiveness of our approach.


title: Randomized tests for high-dimensional regression: A more efficient and powerful solution

abstract: We investigate the problem of testing the global null in the high-dimensional regression models when the feature dimension $p$ grows proportionally to the number of observations $n$. Despite a number of prior work studying this problem, whether there exists a test that is model-agnostic, efficient to compute and enjoys high power, still remains unsettled. In this paper, we answer this question in the affirmative by leveraging the random projection techniques, and propose a testing procedure that blends the classical $F$-test with a random projection step. When combined with a systematic choice of the projection dimension, the proposed procedure is proved to be minimax optimal and, meanwhile, reduces the computation and data storage requirements. We illustrate our results in various scenarios when the underlying feature matrix exhibits an intrinsic lower dimensional structure (such as approximate block structure or has exponential/polynomial eigen-decay), and it turns out that the proposed test achieves sharp adaptive rates. Our theoretical findings are further validated by comparisons to other state-of-the-art tests on the synthetic data.


title: Tracking Controller Design for Satellite Attitude Under Unknown Constant Disturbance Using Stable Embedding

abstract: We propose a tracking control law for the fully actuated rigid body system in the presence of any unknown constant disturbance by employing quaternions with the stable embedding technique and Lyapunov stability theory. The stable embedding technique extends the attitude dynamics from the set of unit quaternions to the set of quaternions, which is a Euclidean space, such that the set of unit quaternions is an invariant set of the extended dynamics. Such a stable extension of the system dynamics to a Euclidean space allows us to employ well studied Lyapunov techniques in Euclidean spaces such as LaSalle-Yoshizawa's theorem. A robust tracking control law is proposed for the attitude dynamics subject to unknown constant disturbance and the convergence properties of the tracking control law is rigorously proven. It is demonstrated with the help of numerical simulations that the proposed control law has a remarkable performance even in some challenging situations.


title: Unsupervised Shadow Removal Using Target Consistency Generative Adversarial Network

abstract: Unsupervised shadow removal aims to learn a non-linear function to map the original image from shadow domain to non-shadow domain in the absence of paired shadow and non-shadow data. In this paper, we develop a simple yet efficient target-consistency generative adversarial network (TC-GAN) for the shadow removal task in the unsupervised manner. Compared with the bidirectional mapping in cycle-consistency GAN based methods for shadow removal, TC-GAN tries to learn a one-sided mapping to cast shadow images into shadow-free ones. With the proposed target-consistency constraint, the correlations between shadow images and the output shadow-free image are strictly confined. Extensive comparison experiments results show that TC-GAN outperforms the state-of-the-art unsupervised shadow removal methods by 14.9% in terms of FID and 31.5% in terms of KID. It is rather remarkable that TC-GAN achieves comparable performance with supervised shadow removal methods.


title: Frontiers in Scalable Distributed Control: SLS, MPC, and Beyond

abstract: The System Level Synthesis (SLS) approach facilitates distributed control of large cyberphysical networks in an easy-to-understand, computationally scalable way. We present an overview of the SLS approach and its associated extensions in nonlinear control, MPC, adaptive control, and learning for control. To illustrate the effectiveness of SLS-based methods, we present a case study motivated by the power grid, with communication constraints, actuator saturation, disturbances, and changing setpoints. This simple but challenging case study necessitates the use of model predictive control (MPC); however, standard MPC techniques often scales poorly to large systems and incurs heavy computational burden. To address this challenge, we combine two SLS-based controllers to form a layered MPC-like controller. Our controller has constant computational complexity with respect to the system size, gives a 20-fold reduction in online computation requirements, and still achieves performance that is within 3% of the centralized MPC controller.


title: Period tripling and quintupling renormalizations below $C^2$ space

abstract: In this paper, we explore the period tripling and period quintupling renormalizations below $C^2$ class of unimodal maps. We show that for a given proper scaling data there exists a renormalization fixed point on the space of piece-wise affine maps which are infinitely renormalizable. Furthermore, we show that this renormalization fixed point is extended to a $C^{1+Lip}$ unimodal map, considering the period tripling and period quintupling combinatorics. Moreover, we show that there exists a continuum of fixed points of renormalizations by considering a small variation on the scaling data. Finally, this leads to the fact that the tripling and quintupling renormalizations acting on the space of $C^{1+Lip}$ unimodal maps have unbounded topological entropy.


title: Homogenization of a two-phase problem with nonlinear dynamic Wentzell-interface condition for connected-disconnected porous media

abstract: We investigate a reaction-diffusion problem in a two-component porous medium with a nonlinear interface condition between the different components. One component is connected and the other one is disconnected. The ratio between the microscopic pore scale and the size of the whole domain is described by the small parameter $\epsilon$. On the interface between the components we consider a dynamic Wentzell-boundary condition, where the normal fluxes from the bulk-domains are given by a reaction-diffusion equation for the traces of the bulk-solutions, including nonlinear reaction-kinetics depending on the solutions on both sides of the interface. Using two-scale techniques, we pass to the limit $\epsilon \to 0$ and derive macroscopic models, where we need homogenization results for surface diffusion. To cope with the nonlinear terms we derive strong two-scale results.


title: On a class of integral systems

abstract: We study spectral problems for two--dimensional integral system with two given non-decreasing functions $R_1$, $R_2$ on an interval $[0,b)$ which is a generalization of the Krein string. Associated to this system are the maximal linear relation $T_{\max}$ and the minimal linear relation $T_{\min}$ in the space $L^2(R_2)$ which are connected by $T_{\max}=T_{\min}^*$. It is shown that the limit point condition at $b$ for this system is equivalent to the strong limit point condition for the linear relation $T_{\max}$. In the limit circle case the strong limit point condition fails to hold on $T_{\max}$ but it is still satisfied on a subspace $T_N^*$ of $T_{\max}$ characterized by the Neumann boundary condition at $b$. The notion of the principal Titchmarsh-Weyl coefficient of this integral system is introduced both in the limit point case and in the limit circle case. Boundary triples for the linear relation $T_{\max}$ in the limit point case (and for $T_{N}^*$ in the limit circle case) are constructed and it is shown that the corresponding Weyl function coincides with the principal Titchmarsh-Weyl coefficient of the integral system. The notion of the dual integral system is introduced by reversing the order of $R_1$ and $R_2$. It is shown that the principal Titchmarsh-Weyl coefficients $q$ and $\widehat q$ of the direct and the dual integral systems are related by the equality $\lambda \widehat q(\lambda) = -1/q(\lambda)$ both in the regular and the singular case.


title: Efficient Identification of Bus Split Events Using Synchrophasor Data

abstract: Accurate grid topology information is of paramount importance for routine power system operations, while the growing availability of synchrophasor data offers the opportunity to identify topology changes in real time. Identification of bus split events, where the substation becomes electrically disconnected, is becoming increasingly important for maintaining the security of power systems. This paper aims to provide an efficient modeling and monitoring framework for bus split events by using a concise bus-branch representation. The linear sensitivity analysis is first performed to quickly evaluate the grid-wide impact of such events. Furthermore, the synchrophasor data enabled identification problem is formulated by matching the changes in bus phase angles (and possibly line flows). To address the resultant bilinear multiplication involving the binary connectivity variables, the McCormick relaxation technique is leveraged to attain an equivalent mixed-integer linear program reformulation that is efficiently solvable. Numerical studies on the IEEE 14-bus and 300-bus systems demonstrate the validity and efficiency of the proposed identification algorithm towards real-time implementation.


title: One-sided Shewhart control charts for monitoring the ratio of two normal variables in Short Production Runs

abstract: Monitoring the ratio of two normal random variables plays an important role in several manufacturing environments. For short production runs, however, the control charts assumed infinite processes cannot function effectively to detect anomalies. In this paper, we tackle this problem by proposing two one-sided Shewhart-type charts to monitor the ratio of two normal random variables for an infinite horizon production. The statistical performance of the proposed charts is investigated using the truncated average run length as a performance measure in short production runs. In order to help the quality practitioner to implement these control charts, we have provided ready-to-use tables of the control limit parameters. An illustrative example from the food industry is given for illustration.


title: Beyond Tabula-Rasa: a Modular Reinforcement Learning Approach for Physically Embedded 3D Sokoban

abstract: Intelligent robots need to achieve abstract objectives using concrete, spatiotemporally complex sensory information and motor control. Tabula rasa deep reinforcement learning (RL) has tackled demanding tasks in terms of either visual, abstract, or physical reasoning, but solving these jointly remains a formidable challenge. One recent, unsolved benchmark task that integrates these challenges is Mujoban, where a robot needs to arrange 3D warehouses generated from 2D Sokoban puzzles. We explore whether integrated tasks like Mujoban can be solved by composing RL modules together in a sense-plan-act hierarchy, where modules have well-defined roles similarly to classic robot architectures. Unlike classic architectures that are typically model-based, we use only model-free modules trained with RL or supervised learning. We find that our modular RL approach dramatically outperforms the state-of-the-art monolithic RL agent on Mujoban. Further, learned modules can be reused when, e.g., using a different robot platform to solve the same task. Together our results give strong evidence for the importance of research into modular RL designs. Project website: https://sites.google.com/view/modular-rl/


title: Adiabatic Floquet-Wave Expansion for the Analysis of Leaky-Wave Holograms Generating Polarized Vortex Beams

abstract: This paper presents the combination of aperture field estimation (AFE) technique and adiabatic Floquet-wave (AFW) expansion method for the analysis of leaky-wave holograms capable of generating orbital angular momentum (OAM) vortex waves. In these formulations the propagation and leakage constants are theoretically estimated and as a result the aperture field and far-zone field are calculated. This theoretical approach significantly reduces the computational complexity in such a way that the analysis of holograms with large dimensions is possible with low memory requirements. Isotropic and anisotropic unit cells are used to realize the holograms, which anisotropic structures show better performance in the control of wave polarization. The holograms are designed to generate vortex beams with topological charge of m=2 and circular polarization states in the microwave regime. To evaluate the accuracy of the proposed method, the results of theoretical model and full-wave simulations are compared, with good agreement.


title: Observation of quantum interference conductance fluctuations in metal rings with strong spin-orbit coupling

abstract: We investigated the magnetotransport properties of mesoscopic platinum nanostructures (wires and rings) with sub-100 nm lateral dimensions at very low temperatures. Despite the strong spin-orbit interaction in platinum, oscillations of the conductance as a function of the external magnetic field due to quantum interference effects was found to appear. The oscillation was decomposed into Aharonov-Bohm periodic oscillations and aperiodic fluctuations of the conductance due to a magnetic flux piercing the loop of the ring and the metal wires forming the nanostructures, respectively. We also investigated the magnetotransport under different bias currents to explore the interplay between electron phase coherence and spin accumulation effects in strong spin-orbit conductors.


title: Deep Convolutional Neural Network Based Facial Expression Recognition in the Wild

abstract: This paper describes the proposed methodology, data used and the results of our participation in the ChallengeTrack 2 (Expr Challenge Track) of the Affective Behavior Analysis in-the-wild (ABAW) Competition 2020. In this competition, we have used a proposed deep convolutional neural network (CNN) model to perform automatic facial expression recognition (AFER) on the given dataset. Our proposed model has achieved an accuracy of 50.77% and an F1 score of 29.16% on the validation set.


title: Length scale dependent elasticity in DNA from coarse-grained and all-atom models

abstract: The mechanical properties of DNA are typically described by elastic theories with purely local couplings (on-site models). We discuss and analyze coarse-grained (oxDNA) and all-atom simulations, which indicate that in DNA distal sites are coupled. Hence, off-site models provide a more realistic description of the mechanics of the double helix. We show that off-site interactions are responsible for a length scale dependence of the elasticity, and we develop an analytical framework to estimate bending and torsional persistence lengths in models including these interactions. Our simulations indicate that off-site couplings are particularly strong for certain degrees of freedom, while they are very weak for others. If stiffness parameters obtained from DNA data are used, the theory predicts large length scale dependent effects for torsional fluctuations and a modest effect in bending fluctuations, which is in agreement with experiments.


title: Imperfect bifurcation in the rotation of a propeller-shaped camphor rotor

abstract: We investigated the bifurcation structure on the self-propelled motion of a camphor rotor at a water surface. The center of the camphor rotor was fixed by the axis, and it showed rotational motion around it. Due to the chiral asymmetry of its shape, the absolute values of the angular velocities in clockwise and counterclockwise directions were different. This asymmetry in the angular velocities implies an imperfect bifurcation. From the numerical simulation results, we discuss the condition for the occurrence of the imperfect bifurcation.


title: Bohr radius for some classes of Harmonic mappings

abstract: We introduce a general class of sense-preserving harmonic mappings defined as follows: \begin{equation*} \mathcal{S}^0_{h+\bar{g}}(M):= \{f=h+\bar{g}: \sum_{m=2}^{\infty}(\gamma_m|a_m|+\delta_m|b_m|)\leq M, \; M>0 \}, \end{equation*} where $h(z)=z+\sum_{m=2}^{\infty}a_mz^m$, $g(z)=\sum_{m=2}^{\infty}b_m z^m$ are analytic functions in $\mathbb{D}:=\{z\in\mathbb{C}: |z|\leq1 \}$ and \begin{equation*} \gamma_m,\; \delta_m \geq \alpha_2:=\min \{\gamma_2, \delta_2\}>0, \end{equation*} for all $m\geq2$. We obtain Growth Theorem, Covering Theorem and derive the Bohr radius for the class $\mathcal{S}^0_{h+\bar{g}}(M)$. As an application of our results, we obtain the Bohr radius for many classes of harmonic univalent functions and some classes of univalent functions.


title: Bounding Boxes Are All We Need: Street View Image Classification via Context Encoding of Detected Buildings

abstract: Street view images classification aiming at urban land use analysis is difficult because the class labels (e.g., commercial area), are concepts with higher abstract level compared to the ones of general visual tasks (e.g., persons and cars). Therefore, classification models using only visual features often fail to achieve satisfactory performance. In this paper, a novel approach based on a "Detector-Encoder-Classifier" framework is proposed. Instead of using visual features of the whole image directly as common image-level models based on convolutional neural networks (CNNs) do, the proposed framework firstly obtains the bounding boxes of buildings in street view images from a detector. Their contextual information such as the co-occurrence patterns of building classes and their layout are then encoded into metadata by the proposed algorithm "CODING" (Context encOding of Detected buildINGs). Finally, these bounding box metadata are classified by a recurrent neural network (RNN). In addition, we made a dual-labeled dataset named "BEAUTY" (Building dEtection And Urban funcTional-zone portraYing) of 19,070 street view images and 38,857 buildings based on the existing BIC GSV [1]. The dataset can be used not only for street view image classification, but also for multi-class building detection. Experiments on "BEAUTY" show that the proposed approach achieves a 12.65% performance improvement on macro-precision and 12% on macro-recall over image-level CNN based models. Our code and dataset are available at https://github.com/kyle-one/Context-Encoding-of-Detected-Buildings/


title: Valid inequalities, preprocessing, and an effective heuristic for the uncapacitated three-level lot-sizing and replenishment problem with a distribution structure

abstract: We consider the uncapacitated three-level lot-sizing and replenishment problem with a distribution structure. In this NP-hard problem, a single production plant sends the produced items to replenish warehouses from where they are dispatched to the retailers in order to satisfy their demands over a finite planning horizon. The goal of the problem is to determine an integrated production and distribution plan minimizing the total costs, which comprehends fixed production and transportation setup as well as variable inventory holding costs. We describe new valid inequalities both in the space of a standard mixed integer programming (MIP) formulation and in that of a new alternative extended MIP formulation. We show that using such extended formulation, valid inequalities having similar structures to those in the standard one allow achieving tighter linear relaxation bounds. Furthermore, we propose a preprocessing approach to reduce the size of a multi-commodity MIP formulation and a multi-start randomized bottom-up dynamic programming based heuristic. Computational experiments indicate that the use of the valid inequalities in a branch-and-cut approach significantly increase the ability of a MIP solver to solve instances to optimality. Additionally, the valid inequalities for the extended formulation outperform those for the standard one in terms of number of solved instances, running time and number of enumerated nodes. Moreover, the proposed heuristic is able to generate solutions with considerably low optimality gaps within very short computational times even for large instances. Combining the preprocessing approach with the heuristic, one can achieve an increase in the number of solutions solved to optimality within the time limit together with significant reductions on the average times for solving them.


title: Phenomenology of vector-like leptons with Deep Learning at the Large Hadron Collider

abstract: In this paper, a model inspired by Grand Unification principles featuring three generations of vector-like fermions, new Higgs doublets and a rich neutrino sector at the low scale is presented. Using the state-of-the-art Deep Learning techniques we perform the first phenomenological analysis of this model focusing on the study of new charged vector-like leptons (VLLs) and their possible signatures at CERN's Large Hadron Collider (LHC). In our numerical analysis we consider signal events for vector-boson fusion and VLL pair production topologies, both involving a final state containing a pair of charged leptons of different flavor and two sterile neutrinos that provide a missing energy. We also consider the case of VLL single production where, in addition to a pair of sterile neutrinos, the final state contains only one charged lepton. All calculated observables are provided as data sets for Deep Learning analysis, where a neural network is constructed, based on results obtained via an evolutive algorithm, whose objective is to maximise either the accuracy metric or the Asimov significance for different masses of the VLL. Taking into account the effect of the three analysed topologies, we have found that the combined significance for the observation of new VLLs at the high-luminosity LHC can range from $5.7\sigma$, for a mass of $1.25~\mathrm{TeV}$, all the way up to $28\sigma$ if the VLL mass is $200~\mathrm{GeV}$. We have also shown that by the end of the LHC Run-III a $200~\mathrm{GeV}$ VLL can be excluded with a confidence of $8.8$ standard deviations. The results obtained show that our model can be probed well before the end of the LHC operations and, in particular, providing important phenomenological information to constrain the energy scale at which new gauge symmetries emergent from the considered Grand Unification picture can be manifest.


title: Condtional Bounds on Siegel Zeros

abstract: We present an overview of bounds on zeros of $L$-functions and obtain some improvements under weak conjectures related to the Goldbach problem.


title: Personality Trait Detection Using Bagged SVM over BERT Word Embedding Ensembles

abstract: Recently, the automatic prediction of personality traits has received increasing attention and has emerged as a hot topic within the field of affective computing. In this work, we present a novel deep learning-based approach for automated personality detection from text. We leverage state of the art advances in natural language understanding, namely the BERT language model to extract contextualized word embeddings from textual data for automated author personality detection. Our primary goal is to develop a computationally efficient, high-performance personality prediction model which can be easily used by a large number of people without access to huge computation resources. Our extensive experiments with this ideology in mind, led us to develop a novel model which feeds contextualized embeddings along with psycholinguistic features toa Bagged-SVM classifier for personality trait prediction. Our model outperforms the previous state of the art by 1.04% and, at the same time is significantly more computationally efficient to train. We report our results on the famous gold standard Essays dataset for personality detection.


title: KELT-11 b: Abundances of water and constraints on carbon-bearing molecules from the Hubble transmission spectrum

abstract: In the past decade, the analysis of exoplanet atmospheric spectra has revealed the presence of water vapour in almost all the planets observed, with the exception of a fraction of overcast planets. Indeed, water vapour presents a large absorption signature in the wavelength coverage of the Hubble Space Telescope's (HST) Wide Field Camera 3 (WFC3), which is the main space-based observatory for atmospheric studies of exoplanets, making its detection very robust. However, while carbon-bearing species such as methane, carbon monoxide and carbon dioxide are also predicted from current chemical models, their direct detection and abundance characterisation has remained a challenge. Here we analyse the transmission spectrum of the puffy, clear hot-Jupiter KELT-11 b from the HST WFC3 camera. We find that the spectrum is consistent with the presence of water vapor and an additional absorption at longer wavelengths than 1.5um, which could well be explained by a mix of carbon bearing molecules. CO2, when included is systematically detected. One of the main difficulties to constrain the abundance of those molecules is their weak signatures across the HST WFC3 wavelength coverage, particularly when compared to those of water. Through a comprehensive retrieval analysis, we attempt to explain the main degeneracies present in this dataset and explore some of the recurrent challenges that are occurring in retrieval studies (e.g: the impact of model selection, the use of free vs self-consistent chemistry and the combination of instrument observations). Our results make this planet an exceptional example of chemical laboratory where to test current physical and chemical models of hot-Jupiters' atmospheres.