title: REXUP: I REason, I EXtract, I UPdate with Structured Compositional Reasoning for Visual Question Answering

abstract: Visual question answering (VQA) is a challenging multi-modal task that requires not only the semantic understanding of both images and questions, but also the sound perception of a step-by-step reasoning process that would lead to the correct answer. So far, most successful attempts in VQA have been focused on only one aspect, either the interaction of visual pixel features of images and word features of questions, or the reasoning process of answering the question in an image with simple objects. In this paper, we propose a deep reasoning VQA model with explicit visual structure-aware textual information, and it works well in capturing step-by-step reasoning process and detecting a complex object-relationship in photo-realistic images. REXUP network consists of two branches, image object-oriented and scene graph oriented, which jointly works with super-diagonal fusion compositional attention network. We quantitatively and qualitatively evaluate REXUP on the GQA dataset and conduct extensive ablation studies to explore the reasons behind REXUP's effectiveness. Our best model significantly outperforms the precious state-of-the-art, which delivers 92.7% on the validation set and 73.1% on the test-dev set.


title: Magnonic Superradiant Phase Transition

abstract: We show that the low-temperature phase transition in ErFeO3 that occurs at a critical temperature of ~ 4 K can be described as a magnonic version of the superradiant phase transition (SRPT). The role of photons in the quantum-optical SRPT is played by Fe magnons, while that of two-level atoms is played by Er spins. Our spin model, which is reduced to an extended Dicke model, takes into account the short-range, direct exchange interactions between Er spins in addition to the long-range Er-Er interactions mediated by Fe magnons. By using realistic parameters determined by recent terahertz magnetospectroscopy and magnetization experiments, we demonstrate that it is the cooperative, ultrastrong coupling between Er spins and Fe magnons that causes the phase transition. This work thus proves ErFeO3 to be a unique system that exhibits a SRPT in thermal equilibrium, in contrast to previous observations of laser-driven non-equilibrium SRPTs.


title: Learning Task-oriented Disentangled Representations for Unsupervised Domain Adaptation

abstract: Unsupervised domain adaptation (UDA) aims to address the domain-shift problem between a labeled source domain and an unlabeled target domain. Many efforts have been made to address the mismatch between the distributions of training and testing data, but unfortunately, they ignore the task-oriented information across domains and are inflexible to perform well in complicated open-set scenarios. Many efforts have been made to eliminate the mismatch between the distributions of training and testing data by learning domain-invariant representations. However, the learned representations are usually not task-oriented, i.e., being class-discriminative and domain-transferable simultaneously. This drawback limits the flexibility of UDA in complicated open-set tasks where no labels are shared between domains. In this paper, we break the concept of task-orientation into task-relevance and task-irrelevance, and propose a dynamic task-oriented disentangling network (DTDN) to learn disentangled representations in an end-to-end fashion for UDA. The dynamic disentangling network effectively disentangles data representations into two components: the task-relevant ones embedding critical information associated with the task across domains, and the task-irrelevant ones with the remaining non-transferable or disturbing information. These two components are regularized by a group of task-specific objective functions across domains. Such regularization explicitly encourages disentangling and avoids the use of generative models or decoders. Experiments in complicated, open-set scenarios (retrieval tasks) and empirical benchmarks (classification tasks) demonstrate that the proposed method captures rich disentangled information and achieves superior performance.


title: Low-lying zeros of a family of quadratic Hecke $L$-functions via ratios conjecture

abstract: In this paper, we apply the ratio conjecture of $L$-functions to derive the lower order terms of the $1$-level density of the low-lying zeros of a family quadratic Hecke $L$-functions in the Gaussian field. Up to the first lower order term, we show that our result is consistent with that obtained from previous work under the generalized Riemann hypothesis, when the Fourier transforms of the test functions are supported in $(-2, 2)$.


title: Unfolding cubes: nets, packings, partitions, chords

abstract: We show that every ridge unfolding of an $n$-cube is without self-overlap, yielding a valid net. The results are obtained by developing machinery that translates cube unfolding into combinatorial frameworks. Moreover, the geometry of the bounding boxes of these cube nets are classified using integer partitions, as well as the combinatorics of path unfoldings seen through the lens of chord diagrams.


title: Limit set of branching random walks on hyperbolic groups

abstract: Let $\Gamma$ be a nonelementary hyperbolic group with a word metric $d$ and $\partial\Gamma$ its hyperbolic boundary equipped with a visual metric $d_a$ for some parameter $a>1$. Fix a superexponential symmetric probability $\mu$ on $\Gamma$ whose support generates $\Gamma$ as a semigroup, and denote by $\rho$ the spectral radius of the random walk $Y$ on $\Gamma$ with step distribution $\mu$. Let $\nu$ be a probability on $\{1,\, 2, \, 3, \, \ldots\}$ with mean $\lambda=\sum\limits_{k=1}^\infty k\nu(k)<\infty$. Let $\mathrm{BRW}(\Gamma, \, \nu, \, \mu)$ be the branching random walk on $\Gamma$ with offspring distribution $\nu$ and base motion $Y$ and $H(\lambda)$ the volume growth rate for the trace of $\mathrm{BRW}(\Gamma, \, \nu, \, \mu)$. We prove for $\lambda \in [1, \, \rho^{-1})$ that the Hausdorff dimension of the limit set $\Lambda$, which is the random subset of $(\partial \Gamma, \, d_a)$ consisting of all accumulation points of the trace of $\mathrm{BRW}(\Gamma, \, \nu, \, \mu)$, is given by $\log_a H(\lambda)$. Furthermore, we prove that $H(\lambda)$ is almost surely a deterministic, strictly increasing and continuous function of $\lambda \in [1, \, \rho^{-1}]$, is bounded by the square root of the volume growth rate of $\Gamma$, and has critical exponent $1/2$ at $\rho^{-1}$ in the sense that \[ H(\rho^{-1}) - H(\lambda) \sim C \sqrt{\rho^{-1} - \lambda} \quad \text{as } \lambda \uparrow \rho^{-1} \] for some positive constant $C$. We conjecture that the Hausdorff dimension of $\Lambda$ in the critical case $\lambda=\rho^{-1}$ is $\log_aH(\rho^{-1})$ almost surely. This has been confirmed on free groups or the free product (by amalgamation) of finitely many finite groups equipped with the word metric $d$ defined by the standard generating set.


title: A template method for Fourier coefficients of Langlands Eisenstein series

abstract: This paper introduces the template method for computing the first coefficient of Langlands Eisenstein series on $\GL(n,\mathbb R)$ and more generally on Chevalley groups over the adele ring of $\mathbb Q.$ In brief, the first coefficient of Borel Eisenstein series can be used as a template to compute the first coefficient of more general Eisenstein series by elementary linear algebra calculations.


title: Characterizing idempotent nullnorms on bounded lattices

abstract: Nullnorms with a zero element being at any point of a bounded lattice are an important generalization of triangular norms and triangular conorms. This paper obtains an equivalent characterization for the existence of idempotent nullnorms with the zero element $a$ on any bounded lattice containing two distinct elements incomparable with $a$. Furthermore, some basic properties for the bounded lattice containing two distinct element incomparable with a are presented.


title: Can We `Feel' the Temperature of Knowledge? Modelling Scientific Popularity Dynamics via Thermodynamics

abstract: Just like everything in the nature, scientific topics flourish and perish. While existing literature well captures article's life-cycle via citation patterns, little is known about how scientific popularity and impact evolves for a specific topic. It would be most intuitive if we could `feel' topic's activity just as we perceive the weather by temperature. Here, we conceive knowledge temperature to quantify topic overall popularity and impact through citation network dynamics. Knowledge temperature includes 2 parts. One part depicts lasting impact by assessing knowledge accumulation with an analogy between topic evolution and isobaric expansion. The other part gauges temporal changes in knowledge structure, an embodiment of short-term popularity, through the rate of entropy change with internal energy, 2 thermodynamic variables approximated via node degree and edge number. Our analysis of representative topics with size ranging from 1000 to over 30000 articles reveals that the key to flourishing is topics' ability in accumulating useful information for future knowledge generation. Topics particularly experience temperature surges when their knowledge structure is altered by influential articles. The spike is especially obvious when there appears a single non-trivial novel research focus or merging in topic structure. Overall, knowledge temperature manifests topics' distinct evolutionary cycles.


title: Superradiant Switching, Quantum Hysteresis, and Oscillations in a Generalized Dicke Model

abstract: We demonstrate quantum signatures of deterministic nonlinear dynamics in the transition to superradiance of a generalized open Dicke model with different coupling strengths for the co- and counter-rotating light-matter interaction terms. A first-order phase transition to coexisting normal and superradiant phases is observed, corresponding with the emergence of switching dynamics between these two phases, driven by quantum fluctuations. We show that this phase coexistence gives rise to a hysteresis loop also for the quantum mechanical system. Additionally, a transition to a superradiant oscillatory phase can be observed clearly in quantum simulations.


title: Privacy-Preserving Resilience of Cyber-Physical Systems to Adversaries

abstract: A cyber-physical system (CPS) is expected to be resilient to more than one type of adversary. In this paper, we consider a CPS that has to satisfy a linear temporal logic (LTL) objective in the presence of two kinds of adversaries. The first adversary has the ability to tamper with inputs to the CPS to influence satisfaction of the LTL objective. The interaction of the CPS with this adversary is modeled as a stochastic game. We synthesize a controller for the CPS to maximize the probability of satisfying the LTL objective under any policy of this adversary. The second adversary is an eavesdropper who can observe labeled trajectories of the CPS generated from the previous step. It could then use this information to launch other kinds of attacks. A labeled trajectory is a sequence of labels, where a label is associated to a state and is linked to the satisfaction of the LTL objective at that state. We use differential privacy to quantify the indistinguishability between states that are related to each other when the eavesdropper sees a labeled trajectory. Two trajectories of equal length will be differentially private if they are differentially private at each state along the respective trajectories. We use a skewed Kantorovich metric to compute distances between probability distributions over states resulting from actions chosen according to policies from related states in order to quantify differential privacy. Moreover, we do this in a manner that does not affect the satisfaction probability of the LTL objective. We validate our approach on a simulation of a UAV that has to satisfy an LTL objective in an adversarial environment.


title: Measuring similarity in co-occurrence data using ego-networks

abstract: The co-occurrence association is widely observed in many empirical data. Mining the information in co-occurrence data is essential for advancing our understanding of systems such as social networks, ecosystem, and brain network. Measuring similarity of entities is one of the important tasks, which can usually be achieved using a network-based approach. Here we show that traditional methods based on the aggregated network can bring unwanted in-directed relationship. To cope with this issue, we propose a similarity measure based on the ego network of each entity, which effectively considers the change of an entity's centrality from one ego network to another. The index proposed is easy to calculate and has a clear physical meaning. Using two different data sets, we compare the new index with other existing ones. We find that the new index outperforms the traditional network-based similarity measures, and it can sometimes surpass the embedding method. In the meanwhile, the measure by the new index is weakly correlated with those by other methods, hence providing a different dimension to quantify similarities in co-occurrence data. Altogether, our work makes an extension in the network-based similarity measure and can be potentially applied in several related tasks.


title: Theoretical constraints on reciprocal and non-reciprocal many-body radiative heat transfer

abstract: We study the constraints on reciprocal and non-reciprocal many-body radiative heat transfer imposed by symmetry and the second law of thermodynamics. We show that the symmetry of such a many-body system in general forms a magnetic group, and the constraints of the magnetic group on the heat transfer can be derived using a generalized reciprocity theorem. We also show that the second law of thermodynamics provides additional constraints in the form of a nodal conservation law of heat flow at equilibrium. As an application, we provide a systematic approach to determine the existence of persistent heat current in arbitrary many-body systems.


title: Total Error and Variability Measures for the Quarterly Workforce Indicators and LEHD Origin-Destination Employment Statistics in OnTheMap

abstract: We report results from the first comprehensive total quality evaluation of five major indicators in the U.S. Census Bureau's Longitudinal Employer-Household Dynamics (LEHD) Program Quarterly Workforce Indicators (QWI): total flow-employment, beginning-of-quarter employment, full-quarter employment, average monthly earnings of full-quarter employees, and total quarterly payroll. Beginning-of-quarter employment is also the main tabulation variable in the LEHD Origin-Destination Employment Statistics (LODES) workplace reports as displayed in OnTheMap (OTM), including OnTheMap for Emergency Management. We account for errors due to coverage; record-level non-response; edit and imputation of item missing data; and statistical disclosure limitation. The analysis reveals that the five publication variables under study are estimated very accurately for tabulations involving at least 10 jobs. Tabulations involving three to nine jobs are a transition zone, where cells may be fit for use with caution. Tabulations involving one or two jobs, which are generally suppressed on fitness-for-use criteria in the QWI and synthesized in LODES, have substantial total variability but can still be used to estimate statistics for untabulated aggregates as long as the job count in the aggregate is more than 10.


title: Sets where Lip $f$ is infinite and lip $f$ is finite

abstract: We characterize the subsets $E \subset \mathbb{R}$ for which there exists a continuous real valued function $f: \mathbb{R}\to\mathbb{R}$ such that lip $f$ is finite everywhere and Lip $f$ is infinite exactly on $E$.


title: Knot Complement, ADO-Invariants and their Deformations for Torus Knots

abstract: A relation between the two-variable series knot invariant and the Akutus-Deguchi-Ohtsuki(ADO)-invariant was conjectured recently. We reinforce the conjecture by presenting explicit formulas and/or an algorithm for certain ADO-invariants of torus knots obtained from the series invariant of complement of a knot. Furthermore, one parameter deformation of ADO_3-polynomial of torus knots is provided.


title: Representation Learning with Video Deep InfoMax

abstract: Self-supervised learning has made unsupervised pretraining relevant again for difficult computer vision tasks. The most effective self-supervised methods involve prediction tasks based on features extracted from diverse views of the data. DeepInfoMax (DIM) is a self-supervised method which leverages the internal structure of deep networks to construct such views, forming prediction tasks between local features which depend on small patches in an image and global features which depend on the whole image. In this paper, we extend DIM to the video domain by leveraging similar structure in spatio-temporal networks, producing a method we call Video Deep InfoMax(VDIM). We find that drawing views from both natural-rate sequences and temporally-downsampled sequences yields results on Kinetics-pretrained action recognition tasks which match or outperform prior state-of-the-art methods that use more costly large-time-scale transformer models. We also examine the effects of data augmentation and fine-tuning methods, accomplishingSoTA by a large margin when training only on the UCF-101 dataset.


title: Heat transport scaling and transition in geostrophic rotating convection with varying aspect ratio

abstract: We present high-precision experimental and numerical studies of the Nusselt number $Nu$ as functions of the Rayleigh number $Ra$ in geostrophic rotating convection with domain aspect ratio ${\Gamma}$ varying from 0.4 to 3.8 and the Ekman number Ek from $2.0{\times}10^{-7}$ to $2.7{\times}10^{-5}$. The heat-transport data $Nu(Ra)$ reveal a gradual transition from buoyancy-dominated to geostrophic convection at large $Ek$, whereas the transition becomes sharp with decreasing $Ek$. We determine the power-law scaling of $Nu{\sim}Ra^{\gamma}$, and show that the boundary flows give rise to pronounced enhancement of $Nu$ in a broad range of the geostrophic regime, leading to reduction of the scaling exponent ${\gamma}$ in small ${\Gamma}$ cells. The present work provides new insight into the heat-transport scaling in geostrophic convection and may explain the discrepancies observed in previous studies.


title: Latent Unexpected Recommendations

abstract: Unexpected recommender system constitutes an important tool to tackle the problem of filter bubbles and user boredom, which aims at providing unexpected and satisfying recommendations to target users at the same time. Previous unexpected recommendation methods only focus on the straightforward relations between current recommendations and user expectations by modeling unexpectedness in the feature space, thus resulting in the loss of accuracy measures in order to improve unexpectedness performance. Contrast to these prior models, we propose to model unexpectedness in the latent space of user and item embeddings, which allows to capture hidden and complex relations between new recommendations and historic purchases. In addition, we develop a novel Latent Closure (LC) method to construct hybrid utility function and provide unexpected recommendations based on the proposed model. Extensive experiments on three real-world datasets illustrate superiority of our proposed approach over the state-of-the-art unexpected recommendation models, which leads to significant increase in unexpectedness measure without sacrificing any accuracy metric under all experimental settings in this paper.


title: The Adaptability and Challenges of Autonomous Vehicles to Pedestrians in Urban China

abstract: China is the world's largest automotive market and is ambitious for autonomous vehicles (AVs) development. As one of the key goals of AVs, pedestrian safety is an important issue in China. Despite the rapid development of driverless technologies in recent years, there is a lack of researches on the adaptability of AVs to pedestrians. To fill the gap, this study would discuss the adaptability of current driverless technologies to China urban pedestrians by reviewing the latest researches. The paper firstly analyzed typical Chinese pedestrian behaviors and summarized the safety demands of pedestrians for AVs through articles and open database data, which are worked as the evaluation criteria. Then, corresponding driverless technologies are carefully reviewed. Finally, the adaptability would be given combining the above analyses. Our review found that autonomous vehicles have trouble in the occluded pedestrian environment and Chinese pedestrians do not accept AVs well. And more explorations should be conducted on standard human-machine interaction, interaction information overload avoidance, occluded pedestrians detection and nation-based receptivity research. The conclusions are very useful for motor corporations and driverless car researchers to place more attention on the complexity of the Chinese pedestrian environment, for transportation experts to protect pedestrian safety in the context of AVs, and for governors to think about making new pedestrians policies to welcome the upcoming driverless cars.


title: The bounds of the spectral radius of general hypergraphs in terms of clique number

abstract: The spectral radius (or the signless Laplacian spectral radius) of a general hypergraph is the maximum modulus of the eigenvalues of its adjacency (or its signless Laplacian) tensor. In this paper, we firstly obtain a lower bound of the spectral radius (or the signless Laplacian spectral radius) of general hypergraphs in terms of clique number. Moreover, we present a relation between a homogeneous polynomial and the clique number of general hypergraphs. As an application, we finally obtain an upper bound of the spectral radius of general hypergraphs in terms of clique number.


title: On the stress dependence of the elastic tensor

abstract: The dependence of the elastic tensor on the equilibrium stress is investigated theoretically. Using ideas from finite-elasticity, it is first shown that both the equilibrium stress and elastic tensor are given uniquely in terms of the equilibrium deformation gradient relative to a fixed choice of reference body. Inversion of the relation between the deformation gradient and stress might, therefore, be expected to lead neatly to the desired expression for the elastic tensor. Unfortunately, the deformation gradient can only be recovered from the stress up to a choice of rotation matrix. Hence it is not possible in general to express the elastic tensor as a unique function of the equilibrium stress. By considering material symmetries, though, it is shown that the degree of non-uniqueness can sometimes be reduced, and in some cases even removed entirely. These results are illustrated through a range numerical calculations, and we also obtain linearised relations applicable to small perturbations in equilibrium stress. Finally, we make a comparison with previous studies, before considering implications for geophysical forward- and inverse-modelling.


title: Research Progress of Convolutional Neural Network and its Application in Object Detection

abstract: With the improvement of computer performance and the increase of data volume, the object detection based on convolutional neural network (CNN) has become the main algorithm for object detection. This paper summarizes the research progress of convolutional neural networks and their applications in object detection, and focuses on analyzing and discussing a specific idea and method of applying convolutional neural networks for object detection, pointing out the current deficiencies and future development direction.


title: Symplectic coordinates on the deformation spaces of convex projective structures on 2-orbifolds

abstract: Let $\mathcal{O}$ be a closed orientable 2-orbifold of negative Euler characteristic. Huebschmann constructed the Atiyah-Bott-Goldman type symplectic form $\omega$ on the deformation space $\mathcal{C}(\mathcal{O})$ of convex projective structures on $\mathcal{O}$. We show that the deformation space $\mathcal{C}(\mathcal{O})$ of convex projective structures on $\mathcal{O}$ admits a global Darboux coordinates system with respect to $\omega$. To this end, we show that $\mathcal{C}(\mathcal{O})$ can be decomposed into smaller symplectic spaces. In the course of the proof, we also study the deformation space $\mathcal{C}(\mathcal{O})$ for an orbifold $\mathcal{O}$ with boundary and construct the symplectic form on the deformation space of convex projective structures on $\mathcal{O}$ with fixed boundary holonomy.


title: Flowing cryogenic liquid target for terahertz wave generation

abstract: Terahertz wave emission from condensed matter excited by intense laser pulses not only reflects the details in laser-matter interaction but also offers bright terahertz wave sources. Flowing liquid targets possess the advantage of providing a fresh area for each laser pulse. To demonstrate a debris-free target under laser excitation, we investigate the use of liquid nitrogen as a target. By creating a flowing liquid nitrogen line in the ambient environment, we successfully observe broadband terahertz wave emission under short pulse excitation. Our cryogenic line is able to sustain the excitation of a high-repetition-rate (1 kHz) laser. The terahertz peak field emitted from liquid nitrogen is comparable to that from liquid water, yet a broader bandwidth is observed. This demonstration prompts new opportunities in choosing potential materials for studying terahertz wave generation process and in understanding laser-induced ionization in different liquids.


title: Recommending Podcasts for Cold-Start Users Based on Music Listening and Taste

abstract: Recommender systems are increasingly used to predict and serve content that aligns with user taste, yet the task of matching new users with relevant content remains a challenge. We consider podcasting to be an emerging medium with rapid growth in adoption, and discuss challenges that arise when applying traditional recommendation approaches to address the cold-start problem. Using music consumption behavior, we examine two main techniques in inferring Spotify users preferences over more than 200k podcasts. Our results show significant improvements in consumption of up to 50\% for both offline and online experiments. We provide extensive analysis on model performance and examine the degree to which music data as an input source introduces bias in recommendations.


title: On the Regularization Effect of Stochastic Gradient Descent applied to Least Squares

abstract: We study the behavior of stochastic gradient descent applied to $\|Ax -b \|_2^2 \rightarrow \min$ for invertible $A \in \mathbb{R}^{n \times n}$. We show that there is an explicit constant $c_{A}$ depending (mildly) on $A$ such that $$ \mathbb{E} ~\left\| Ax_{k+1}-b\right\|^2_{2} \leq \left(1 + \frac{c_{A}}{\|A\|_F^2}\right) \left\|A x_k -b \right\|^2_{2} - \frac{2}{\|A\|_F^2} \left\|A^T A (x_k - x)\right\|^2_{2}.$$ This is a curious inequality: the last term has one more matrix applied to the residual $u_k - u$ than the remaining terms: if $x_k - x$ is mainly comprised of large singular vectors, stochastic gradient descent leads to a quick regularization. For symmetric matrices, this inequality has an extension to higher-order Sobolev spaces. This explains a (known) regularization phenomenon: an energy cascade from large singular values to small singular values smoothes.


title: AlphaBlock: An Evaluation Framework for Blockchain Consensus Protocols

abstract: Consensus protocols play a pivotal role to balance security and efficiency in blockchain systems. In this paper, we propose an evaluation framework for blockchain consensus protocols termed as AlphaBlock. In this framework, we compare the overall performance of Byzantine Fault Tolerant (BFT) consensus and Nakamoto Consensus (NC). BFT consensus is reached by multiple rounds of quorum votes from the supermajority, while NC is reached by accumulating credibility with the implicit voting from appending blocks. AlphaBlock incorporates the key concepts of Hotstu BFT (HBFT) and Proof-of-authority (PoA) as the case study of BFT and NC. Using this framework, we compare the throughput and latency of HBFT and PoA with practical network and blockchain configurations. Our results show that the performance of HBFT dominates PoA in most scenarios due to the absence of forks in HBFT. Moreover, we find out a set of optimal configurations in AlphaBlock, which sheds a light for improving the performance of blockchain consensus algorithms.


title: Deep Learning Methods for Solving Linear Inverse Problems: Research Directions and Paradigms

abstract: The linear inverse problem is fundamental to the development of various scientific areas. Innumerable attempts have been carried out to solve different variants of the linear inverse problem in different applications. Nowadays, the rapid development of deep learning provides a fresh perspective for solving the linear inverse problem, which has various well-designed network architectures results in state-of-the-art performance in many applications. In this paper, we present a comprehensive survey of the recent progress in the development of deep learning for solving various linear inverse problems. We review how deep learning methods are used in solving different linear inverse problems, and explore the structured neural network architectures that incorporate knowledge used in traditional methods. Furthermore, we identify open challenges and potential future directions along this research line.


title: Lah-Bell numbers and polynomials

abstract: In this paper, we introduce the Lah-Bell numbers and their natural extensions, namely the Lah-Bell polynomials, and derive some basic properties of such numbers and polynomials by using elementary methods. In addition, we consider the degenerate Lah-Bell numbers and polynomials as degenerate versions of the Lah-Bell numbers and polynomials.


title: A convergent post-processed discontinuous Galerkin method for incompressible flow with variable density

abstract: We propose a linearized semi-implicit and decoupled finite element method for the incompressible Navier--Stokes equations with variable density. Our method is fully discrete and shown to be unconditionally stable. The velocity equation is solved by an H1-conforming finite element method, and an upwind discontinuous Galerkin finite element method with post-processed velocity is adopted for the density equation. The proposed method is proved to be convergent in approximating reasonably smooth solutions in three-dimensional convex polyhedral domains.


title: Outage Probability and Capacity Scaling Law of Multiple RIS-Aided Cooperative Networks

abstract: In this letter, we consider a dual-hop cooperative network assisted by multiple reconfigurable intelligent surfaces (RISs). Assuming that the RIS with the highest instantaneous end-to-end signal-to-noise ratio (SNR) is selected to aid the communication, the outage probability (OP) and average sum-rate are investigated. Specifically, an exact analysis for the OP is developed. In addition, relying on the extreme value theory, closed-form expressions for the asymptotic OP and asymptotic sum-rate are derived, based on which the capacity scaling law is established. Our results are corroborated through simulations and insightful discussions are provided. In particular, our analysis shows that the number of RISs as well as the number of reflecting elements play a crucial role in the capacity scaling law of multiple RIS-aided cooperative networks. Also, comparisons with relay-aided systems are carried out to demonstrate that the proposed system setup outperforms relaying schemes both in terms of the OP and average sum-rate.


title: Role of Mann Counterterm in Gravitational Energy

abstract: In 1999, R. B. Mann proposed a counterterm that is some sort of generalization of the well-known Holographic counterterm and that can eliminate the divergence of the gravitational action of asymptotically AdS and flat spacetimes (Phys. Rev. D $\boldsymbol{60}$ (1999) 104047 [1]). I show it is not only for eliminating the divergence of such spacetimes but also for setting the ground state energy to zero for any $d$-dimensional spacetimes with an $S^{d-2} \times \mathbb{R} $ boundary geometry, and speculate it is also true for spacetimes with any (suitable) boundary geometry and topology.


title: Aerial Intelligent Reflecting Surface: Joint Placement and Passive Beamforming Design with 3D Beam Flattening

abstract: This paper proposes a new three-dimensional (3D) wireless passive relaying system enabled by aerial IRS (AIRS). Compared to the conventional terrestrial IRS, AIRS enjoys more deployment flexibility as well as wider-range signal reflection, thanks to its high altitude and thus more likelihood of establishing line-of-sight (LoS) links with ground source/destination nodes. Specifically, we aim to maximize the worst-case signal-to-noise ratio (SNR) over all locations in a target area by jointly optimizing the transmit beamforming for the source node and the placement as well as 3D passive beamforming for the AIRS. The formulated problem is non-convex and thus difficult to solve. To gain useful insights, we first consider the special case of maximizing the SNR at a given target location, for which the optimal solution is obtained in closed-form. The result shows that the optimal horizontal AIRS placement only depends on the ratio between the source-destination distance and the AIRS altitude. Then for the general case of AIRS-enabled area coverage, we propose an efficient solution by decoupling the AIRS passive beamforming design to maximize the worst-case array gain, from its placement optimization by balancing the resulting angular span and the cascaded channel path loss. Our proposed solution is based on a novel 3D beam broadening and flattening technique, where the passive array of the AIRS is divided into sub-arrays of appropriate size, and their phase shifts are designed to form a flattened beam pattern with adjustable beamwidth catering to the size of the coverage area. Both the uniform linear array (ULA)-based and uniform planar array (UPA)-based AIRSs are considered in our design, which enable two-dimensional (2D) and 3D passive beamforming, respectively. Numerical results show that the proposed designs achieve significant performance gains over the benchmark schemes.


title: Supervised Learning in Temporally-Coded Spiking Neural Networks with Approximate Backpropagation

abstract: In this work we propose a new supervised learning method for temporally-encoded multilayer spiking networks to perform classification. The method employs a reinforcement signal that mimics backpropagation but is far less computationally intensive. The weight update calculation at each layer requires only local data apart from this signal. We also employ a rule capable of producing specific output spike trains; by setting the target spike time equal to the actual spike time with a slight negative offset for key high-value neurons the actual spike time becomes as early as possible. In simulated MNIST handwritten digit classification, two-layer networks trained with this rule matched the performance of a comparable backpropagation based non-spiking network.


title: Quantitative spectral gaps and uniform lower bounds in the small noise limit for Markov semigroups generated by hypoelliptic stochastic differential equations

abstract: We study the convergence rate to equilibrium for a family of Markov semigroups $\{\mathcal{P}_t^{\epsilon}\}_{\epsilon > 0}$ generated by a class of hypoelliptic stochastic differential equations on $\mathbb{R}^d$, including Galerkin truncations of the incompressible Navier-Stokes equations, Lorenz-96, and the shell model SABRA. In the regime of vanishing, balanced noise and dissipation, we obtain a sharp (in terms of scaling) quantitative estimate on the exponential convergence in terms of the small parameter $\epsilon$. By scaling, this regime implies corresponding optimal results both for fixed dissipation and large noise limits or fixed noise and vanishing dissipation limits. As part of the proof, and of independent interest, we obtain uniform-in-$\epsilon$ upper and lower bounds on the density of the stationary measure. Upper bounds are obtained by a hypoelliptic Moser iteration, the lower bounds by a de Giorgi-type iteration (both uniform in $\epsilon$). The spectral gap estimate on the semigroup is obtained by a weak Poincar\'e inequality argument combined with quantitative hypoelliptic regularization of the time-dependent problem.


title: Characterizing matroids whose bases form graphic delta-matroids

abstract: We introduce delta-graphic matroids, which are matroids whose bases form graphic delta-matroids. The class of delta-graphic matroids contains graphic matroids as well as cographic matroids and is a proper subclass of the class of regular matroids. We give a structural characterization of the class of delta-graphic matroids. We also show that every forbidden minor for the class of delta-graphic matroids has at most $48$ elements.


title: Enhanced Beam Alignment for Millimeter Wave MIMO Systems: A Kolmogorov Model

abstract: We present an enhancement to the problem of beam alignment in millimeter wave (mmWave) multiple-input multiple-output (MIMO) systems, based on a modification of the machine learning-based criterion, called Kolmogorov model (KM), previously applied to the beam alignment problem. Unlike the previous KM, whose computational complexity is not scalable with the size of the problem, a new approach, centered on discrete monotonic optimization (DMO), is proposed, leading to significantly reduced complexity. We also present a Kolmogorov-Smirnov (KS) criterion for the advanced hypothesis testing, which does not require any subjective threshold setting compared to the frequency estimation (FE) method developed for the conventional KM. Simulation results that demonstrate the efficacy of the proposed KM learning for mmWave beam alignment are presented.


title: Evaluation of Federated Learning in Phishing Email Detection

abstract: The use of Artificial Intelligence (AI) to detect phishing emails is primarily dependent on large-scale centralized datasets, which opens it up to a myriad of privacy, trust, and legal issues. Moreover, organizations are loathed to share emails, given the risk of leakage of commercially sensitive information. So, it is uncommon to obtain sufficient emails to train a global AI model efficiently. Accordingly, privacy-preserving distributed and collaborative machine learning, particularly Federated Learning (FL), is a desideratum. Already prevalent in the healthcare sector, questions remain regarding the effectiveness and efficacy of FL-based phishing detection within the context of multi-organization collaborations. To the best of our knowledge, the work herein is the first to investigate the use of FL in email anti-phishing. This paper builds upon a deep neural network model, particularly RNN and BERT for phishing email detection. It analyzes the FL-entangled learning performance under various settings, including balanced and asymmetrical data distribution. Our results corroborate comparable performance statistics of FL in phishing email detection to centralized learning for balanced datasets, and low organization counts. Moreover, we observe a variation in performance when increasing organizational counts. For a fixed total email dataset, the global RNN based model suffers by a 1.8% accuracy drop when increasing organizational counts from 2 to 10. In contrast, BERT accuracy rises by 0.6% when going from 2 to 5 organizations. However, if we allow increasing the overall email dataset with the introduction of new organizations in the FL framework, the organizational level performance is improved by achieving a faster convergence speed. Besides, FL suffers in its overall global model performance due to highly unstable outputs if the email dataset distribution is highly asymmetric.


title: Theoretical Description of Hyperpolarization Formation in the SABRE-relay Method

abstract: SABRE (Signal Amplification By Reversible Exchange) has become a widely used method for hyper-polarizing nuclear spins, thereby enhancing their Nuclear Magnetic Resonance (NMR) signals by orders of magnitude. In SABRE experiments, non-equilibrium spin order is transferred from parahydrogen to a substrate in a transient organometallic complex. Applicability of SABRE is expanded by the methodology of SABRE-relay, in which polarization can be relayed to a second substrate either by direct chemical exchange of hyperpolarized nuclei or by polarization transfer between two substrates in a second organometallic complex. To understand the mechanism of the polarization transfer and study the transfer efficiency, we propose a theoretical approach to SABRE-relay, which can treat both spin dynamics and chemical kinetics as well as the interplay between them. The approach is based on a set of equations for the spin density matrices of the spin systems involved (i.e., SABRE substrates and complexes), which can be solved numerically. Using this method, we perform a detailed study of polarization formation and analyse in detail the dependence of attainable polarization level on various chemical kinetic and spin dynamic parameters. We foresee applications of the present approach for optimizing SABRE-relay experiments with the ultimate goal of achieving maximal NMR signal enhancements for substrates of interest.


title: Random Graph Asymptotics for Treatment Effect Estimation under Network Interference

abstract: The network interference model for causal inference places all experimental units at the vertices of an undirected exposure graph, such that treatment assigned to one unit may affect the outcome of another unit if and only if these two units are connected by an edge. This model has recently gained popularity as means of incorporating interference effects into the Neyman--Rubin potential outcomes framework; and several authors have considered estimation of various causal targets, including the direct and indirect effects of treatment. In this paper, we consider large-sample asymptotics for treatment effect estimation under network interference in a setting where the exposure graph is a random draw from a graphon. When targeting the direct effect, we show that -- in our setting -- popular estimators are considerably more accurate than existing results suggest, and provide a central limit theorem in terms of moments of the graphon. Meanwhile, when targeting the indirect effect, we leverage our generative assumptions to propose a consistent estimator in a setting where no other consistent estimators are currently available. We also show how our results can be used to conduct a practical assessment of the sensitivity of randomized study inference to potential interference effects. Overall, our results highlight the promise of random graph asymptotics in understanding the practicality and limits of causal inference under network interference.


title: Reconstructing NBA Players

abstract: Great progress has been made in 3D body pose and shape estimation from a single photo. Yet, state-of-the-art results still suffer from errors due to challenging body poses, modeling clothing, and self occlusions. The domain of basketball games is particularly challenging, as it exhibits all of these challenges. In this paper, we introduce a new approach for reconstruction of basketball players that outperforms the state-of-the-art. Key to our approach is a new method for creating poseable, skinned models of NBA players, and a large database of meshes (derived from the NBA2K19 video game), that we are releasing to the research community. Based on these models, we introduce a new method that takes as input a single photo of a clothed player in any basketball pose and outputs a high resolution mesh and 3D pose for that player. We demonstrate substantial improvement over state-of-the-art, single-image methods for body shape reconstruction.


title: A well-posedness theory in Sobolev spaces for the stochastic magnetohydrodynamic equations in the whole space

abstract: We prove the existence of a mild solution to the three dimensional incompressible stochastic magnetohydrodynamic equations in the whole space with the initial data which belong to the Sobolev spaces.


title: Controlling the Outbreak of COVID-19: A Noncooperative Game Perspective

abstract: COVID-19 is a global epidemic. Till now, there is no remedy for this epidemic. However, isolation and social distancing are seemed to be effective preventive measures to control this pandemic. Therefore, in this paper, an optimization problem is formulated that accommodates both isolation and social distancing features of the individuals. To promote social distancing, we solve the formulated problem by applying a noncooperative game that can provide an incentive for maintaining social distancing to prevent the spread of COVID-19. Furthermore, the sustainability of the lockdown policy is interpreted with the help of our proposed game-theoretic incentive model for maintaining social distancing where there exists a Nash equilibrium. Finally, we perform an extensive numerical analysis that shows the effectiveness of the proposed approach in terms of achieving the desired social-distancing to prevent the outbreak of the COVID-19 in a noncooperative environment. Numerical results show that the individual incentive increases more than 85% with an increasing percentage of home isolation from 25% to 100% for all considered scenarios. The numerical results also demonstrate that in a particular percentage of home isolation, the individual incentive decreases with an increasing number of individuals.


title: Public Sentiment Toward Solar Energy: Opinion Mining of Twitter Using a Transformer-Based Language Model

abstract: Public acceptance and support for renewable energy are important determinants of renewable energy policies and market conditions. This paper examines public sentiment toward solar energy in the United States using data from Twitter, a micro-blogging platform in which people post messages, known as tweets. We filtered tweets specific to solar energy and performed a classification task using Robustly optimized Bidirectional Encoder Representations from Transformers (RoBERTa). Analyzing 71,262 tweets during the period of late January to early July 2020, we find public sentiment varies significantly across states. Within the study period, the Northeastern U.S. region shows more positive sentiment toward solar energy than did the Southern U.S. region. Solar radiation does not correlate to variation in solar sentiment across states. We also find that public sentiment toward solar correlates to renewable energy policy and market conditions, specifically, Renewable Portfolio Standards (RPS) targets, customer-friendly net metering policies, and a mature solar market.


title: Knotted Polarizations and Spin in 3D Polychromatic Waves

abstract: We consider complex 3D polarizations in the interference of several vector wave fields with different commensurable frequencies and polarizations. We show that the resulting polarizations can form knots, and interfering three waves is sufficient to generate a variety of Lissajous, torus, and other knot types. We describe the spin angular momentum, generalized Stokes parameters and degree of polarization for such knotted polarizations, which can be regarded as partially-polarized. Our results are generic for any vector wave fields, including, e.g., optical and acoustic waves. As a directly-observable example, we consider knotted trajectories of water particles in the interference of surface water (gravity) waves with three different frequencies.


title: On the sizes of bipartite 1-planar graphs

abstract: A graph is called $1$-planar if it admits a drawing in the plane such that each edge is crossed at most once. Let $G$ be a bipartite 1-planar graph with $n$ ($\ge 4$) vertices and $m$ edges. Karpov showed that $m\le 3n-8$ holds for even $n\ge 8$ and $m\le 3n-9$ holds for odd $n\ge 7$. Czap, Przybylo and \u{S}krabul\'{a}kov\'{a} proved that if the partite sets of $G$ are of sizes $x$ and $y$, then $m\le 2n+6x-12$ holds for $2\leq x\leq y$, and conjectured that $m\le 2n+4x-12$ holds for $x\ge 3$ and $y\ge 6x-12$. In this paper, we settle their conjecture and our result is even under a weaker condition $2\le x\le y$.


title: Hermitian dual-containing constacyclic BCH codes and related quantum codes of length $\frac{q^{2m}-1}{q+1}$

abstract: In this paper, we study a family of constacyclic BCH codes over $\mathbb{F}_{q^2}$ of length $n=\frac{q^{2m}-1}{q+1}$, where $q$ is a prime power, and $m\geq2$ an even integer. The maximum design distance of narrow-sense Hermitian dual-containing constacyclic BCH codes of length $n$ is determined. Furthermore, the exact dimension of the constacyclic BCH codes with given design distance is computed. As a consequence, we are able to derive the parameters of quantum codes as a function of their design parameters of the associated constacyclic BCH codes. This improves the result by Yuan et al. (Des Codes Cryptogr 85(1): 179-190, 2017), showing that with the same lengths, except for three trivial cases ($q=2,3,4$), our resultant quantum codes can always yield strict dimension or minimum distance gains than the ones obtained by Yuan et al.. Moreover, fixing length $n=\frac{q^{2m}-1}{q+1}$, some constructed quantum codes have better parameters or are beneficial complements compared with some known results (Aly et al., IEEE Trans Inf Theory 53(3): 1183-1188, 2007, Li et al., Quantum Inf Process 18(5): 127, 2019, Wang et al., Quantum Inf Process 18(8): 323, 2019, Song et al., Quantum Inf Process 17(10): 1-24, 2018.).


title: K-Shot Contrastive Learning of Visual Features with Multiple Instance Augmentations

abstract: In this paper, we propose the $K$-Shot Contrastive Learning (KSCL) of visual features by applying multiple augmentations to investigate the sample variations within individual instances. It aims to combine the advantages of inter-instance discrimination by learning discriminative features to distinguish between different instances, as well as intra-instance variations by matching queries against the variants of augmented samples over instances. Particularly, for each instance, it constructs an instance subspace to model the configuration of how the significant factors of variations in $K$-shot augmentations can be combined to form the variants of augmentations. Given a query, the most relevant variant of instances is then retrieved by projecting the query onto their subspaces to predict the positive instance class. This generalizes the existing contrastive learning that can be viewed as a special one-shot case. An eigenvalue decomposition is performed to configure instance subspaces, and the embedding network can be trained end-to-end through the differentiable subspace configuration. Experiment results demonstrate the proposed $K$-shot contrastive learning achieves superior performances to the state-of-the-art unsupervised methods.


title: Properties of dynamical fractal geometries in the model of Causal Dynamical Triangulations

abstract: We investigate the geometry of a quantum universe with the topology of the four-torus. The study of non-contractible geodesic loops reveals that a typical quantum geometry consists of a small semi-classical toroidal bulk part, dressed with many outgrowths, which contain most of the four-volume and which have almost spherical topologies, but nevertheless are quite fractal.


title: Split Computing for Complex Object Detectors: Challenges and Preliminary Results

abstract: Following the trends of mobile and edge computing for DNN models, an intermediate option, split computing, has been attracting attentions from the research community. Previous studies empirically showed that while mobile and edge computing often would be the best options in terms of total inference time, there are some scenarios where split computing methods can achieve shorter inference time. All the proposed split computing approaches, however, focus on image classification tasks, and most are assessed with small datasets that are far from the practical scenarios. In this paper, we discuss the challenges in developing split computing methods for powerful R-CNN object detectors trained on a large dataset, COCO 2017. We extensively analyze the object detectors in terms of layer-wise tensor size and model size, and show that naive split computing methods would not reduce inference time. To the best of our knowledge, this is the first study to inject small bottlenecks to such object detectors and unveil the potential of a split computing approach. The source code and trained models' weights used in this study are available at https://github.com/yoshitomo-matsubara/hnd-ghnd-object-detectors .


title: Charged Current Drell-Yan Production at N3LO

abstract: We present the production cross section for a lepton-neutrino pair at the Large Hadron Collider computed at next-to-next-to-next-to leading order (N3LO) in QCD perturbation theory. We compute the partonic coefficient functions of a virtual $W^{\pm}$ boson at this order. We then use these analytic functions to study the progression of the perturbative series in different observables. In particular, we investigate the impact of the newly obtained corrections on the inclusive production cross section of $W^{\pm}$ bosons, as well as on the ratios of the production cross sections for $W^+$, $W^-$ and/or a virtual photon. Finally, we present N3LO predictions for the charge asymmetry at the LHC.


title: Rethinking Generative Zero-Shot Learning: An Ensemble Learning Perspective for Recognising Visual Patches

abstract: Zero-shot learning (ZSL) is commonly used to address the very pervasive problem of predicting unseen classes in fine-grained image classification and other tasks. One family of solutions is to learn synthesised unseen visual samples produced by generative models from auxiliary semantic information, such as natural language descriptions. However, for most of these models, performance suffers from noise in the form of irrelevant image backgrounds. Further, most methods do not allocate a calculated weight to each semantic patch. Yet, in the real world, the discriminative power of features can be quantified and directly leveraged to improve accuracy and reduce computational complexity. To address these issues, we propose a novel framework called multi-patch generative adversarial nets (MPGAN) that synthesises local patch features and labels unseen classes with a novel weighted voting strategy. The process begins by generating discriminative visual features from noisy text descriptions for a set of predefined local patches using multiple specialist generative models. The features synthesised from each patch for unseen classes are then used to construct an ensemble of diverse supervised classifiers, each corresponding to one local patch. A voting strategy averages the probability distributions output from the classifiers and, given that some patches are more discriminative than others, a discrimination-based attention mechanism helps to weight each patch accordingly. Extensive experiments show that MPGAN has significantly greater accuracy than state-of-the-art methods.


title: Sobolev metrics on spaces of manifold valued curves

abstract: We study completeness properties of reparametrization invariant Sobolev metrics of order $n\ge 2$ on the space of manifold valued open and closed immersed curves. In particular, for several important cases of metrics, we show that Sobolev immersions are metrically and geodesically complete (thus the geodesic equation is globally well-posed). These results were previously known only for closed curves with values in Euclidean space. For the class of constant coefficient Sobolev metrics on open curves, we show that they are metrically incomplete, and that this incompleteness only arises from curves that vanish completely (unlike "local" failures that occur in lower order metrics).


title: DCDIR: A Deep Cross-Domain Recommendation System for Cold Start Users in Insurance Domain

abstract: Internet insurance products are apparently different from traditional e-commerce goods for their complexity, low purchasing frequency, etc.So, cold start problem is even worse. In traditional e-commerce field, several cross-domain recommendation (CDR) methods have been studied to infer preferences of cold start users based on their preferences in other domains. However, these CDR methods could not be applied into insurance domain directly due to product complexity. In this paper, we propose a Deep Cross Domain Insurance Recommendation System (DCDIR) for cold start users. Specifically, we first learn more effective user and item latent features in both domains. In target domain, given the complexity of insurance products, we design meta path based method over insurance product knowledge graph. In source domain, we employ GRU to model user dynamic interests. Then we learn a feature mapping function by multi-layer perceptions. We apply DCDIR on our company datasets, and show DCDIR significantly outperforms the state-of-the-art solutions.


title: Plasmonic lattice Kerker effect in UV-Vis spectral range

abstract: Mostly forsaken, but revived after the emergence of all-dielectric nanophotonics, the Kerker effect can be observed in a variety of nanostructures from high-index constituents with strong electric and magnetic Mie resonances. Necessary requirement for the existence of a magnetic response limits the use of generally non-magnetic conventional plasmonic nanostructures for the Kerker effect. In spite of this, we demonstrate here for the first time the emergence of the lattice Kerker effect in regular plasmonic Al nanostructures. Collective lattice oscillations emerging from delicate interplay between Rayleigh anomalies and localized surface plasmon resonances both of electric and magnetic dipoles, and electric and magnetic quadrupoles result in suppression of the backscattering in a broad spectral range. Variation of geometrical parameters of Al arrays allows for tailoring lattice Kerker effect throughout UV and visible wavelength ranges, which is close to impossible to achieve using other plasmonic or all-dielectric materials. It is argued that our results set the ground for wide ramifications in the plasmonics and further application of the Kerker effect.


title: Stacking Redshifted 21cm Images of HII Regions Around High Redshift Galaxies as a Probe of Early Reionization

abstract: A number of current and future experiments aim to detect the reionization of neutral hydrogen by the first stars and galaxies in the Universe via the redshifted 21cm line. Using the \textsc{BlueTides} simulation, we investigate the measurement of an \textit{average} ionised region towards the beginning of reionization by stacking redshifted 21cm images around optically identified bright galaxies using mock observations. We find that with an SKA 1000 hour observation, assuming perfect foreground subtraction, a $5\sigma$ detection of a stacked HII region can be made with 30 images around some of the brightest galaxies in \textsc{bluetides} (brighter than $M_{UV} < -22.75$) at $z=9$ (corresponding to a neutral fraction of 90.1 \% in our model). We present simulated relationships between the UV magnitude of galaxies, the sizes of the ionised regions they reside in, and the shape of the stacked profiles. These mock observations can also distinguish between scenarios where the IGM is in net emission or absorption of 21cm photons. Once 21cm foreground contamination is included, we find that even with up to 200 images around these rare, bright galaxies, only a tentative $> 1\sigma$ detection will be possible. However, partial foreground subtraction substantially improves signal-to-noise. For example, we predict that reducing the area of Fourier space dominated by foregrounds by 50 (80) percent will allow $> 3\sigma$ ($> 5\sigma$) detections of ionised regions at $z=9$.


title: Projections in Toeplitz algebra

abstract: Motivated by Barr{\'\i}a-Halmos's \cite[Question 19]{barria1982asymptotic} and Halmos's \cite[Problem 237]{Halmos1978A}, we explore projections in Toeplitz algebra on the Hardy space. We show that the product of two Toeplitz (Hankel) operators is a projection if and only if it is the projection onto one of the invariant subspaces of the shift (backward shift) operator. As a consequence one obtains new proofs of criterion for Toeplitz operators and Hankel operators to be partial isometries. Furthermore, we completely characterize when the self-commutator of a Toeplitz operator is a projection. This provides a class of nontrivial projections in Toeplitz algebra.


title: Scale and quality of Peccei-Quinn symmetry and weak gravity conjectures

abstract: The promising solution to the strong CP problem by a Peccei-Quinn (PQ) symmetry may introduce quality and hierarchy problems, which are both relevant to Planck physics. In this paper, we study whether both problems can be explained by introducing a simple hidden gauge group that satisfies a weak gravity conjecture (WGC) or its variant. As a concrete example, we point out that a weakly-coupled hidden $SU(N)$ gauge symmetry, which is broken down to $SO(N)$, can do this job in the context of a Tower/sub-Lattice WGC. Cosmology is discussed.


title: Three Numerical Eigensolvers for 3-D Cavity Resonators Filled With Anisotropic and Nonconductive Media

abstract: This paper mainly investigates the classic resonant cavity problem with anisotropic and nonconductive media, which is a linear vector Maxwell's eigenvalue problem. The finite element method based on edge element of the lowest-order and standard linear element is used to solve this type of 3-D closed cavity problem. In order to eliminate spurious zero modes in the numerical simulation, the divergence-free condition supported by Gauss' law is enforced in a weak sense. After the finite element discretization, the generalized eigenvalue problem with a linear constraint condition needs to be solved. Penalty method, augmented method and projection method are applied to solve this difficult problem in numerical linear algebra. The advantages and disadvantages of these three computational methods are also given in this paper. Furthermore, we prove that the augmented method is free of spurious modes as long as the anisotropic material is not magnetic lossy. The projection method based on singular value decomposition technique can be used to solve the resonant cavity problem. Moreover, the projection method {cannot} introduce any spurious modes. At last, several numerical experiments are carried out to verify our theoretical results.


title: Stabilizing Bi-Level Hyperparameter Optimization using Moreau-Yosida Regularization

abstract: This research proposes to use the Moreau-Yosida envelope to stabilize the convergence behavior of bi-level Hyperparameter optimization solvers, and introduces the new algorithm called Moreau-Yosida regularized Hyperparameter Optimization (MY-HPO) algorithm. Theoretical analysis on the correctness of the MY-HPO solution and initial convergence analysis is also provided. Our empirical results show significant improvement in loss values for a fixed computation budget, compared to the state-of-art bi-level HPO solvers.


title: Active pooling design in group testing based on Bayesian posterior prediction

abstract: In identifying infected patients in a population, group testing is an effective method to reduce the number of tests and correct the test errors. In the group testing procedure, tests are performed on pools of specimens collected from patients, where the number of pools is lower than that of patients. The performance of group testing heavily depends on the design of pools and algorithms that are used in inferring the infected patients from the test outcomes. In this paper, an adaptive design method of pools based on the predictive distribution is proposed in the framework of Bayesian inference. The proposed method executed using the belief propagation algorithm results in more accurate identification of the infected patients, as compared to the group testing performed on random pools determined in advance.


title: Inexact Newton Method for M-Tensor Equations

abstract: We first investigate properties of M-tensor equations. In particular, we show that if the constant term of the equation is nonnegative, then finding a nonnegative solution of the equation can be done by finding a positive solution of a lower dimensional M-tensor equation. We then propose an inexact Newton method to find a positive solution to the lower dimensional equation and establish its global convergence. We also show that the convergence rate of the method is quadratic. At last, we do numerical experiments to test the proposed Newton method. The results show that the proposed Newton method has a very good numerical performance.


title: Analysis of Emotional Content in Indian Political Speeches

abstract: Emotions play an essential role in public speaking. The emotional content of speech has the power to influence minds. As such, we present an analysis of the emotional content of politicians speech in the Indian political scenario. We investigate the emotional content present in the speeches of politicians using an Attention based CNN+LSTM network. Experimental evaluations on a dataset of eight Indian politicians shows how politicians incorporate emotions in their speeches to strike a chord with the masses. An analysis of the voting share received along with victory margin and their relation to emotional content in speech of the politicians is also presented.


title: Deep-learning-based surrogate flow modeling and geological parameterization for data assimilation in 3D subsurface flow

abstract: Data assimilation in subsurface flow systems is challenging due to the large number of flow simulations often required, and by the need to preserve geological realism in the calibrated (posterior) models. In this work we present a deep-learning-based surrogate model for two-phase flow in 3D subsurface formations. This surrogate model, a 3D recurrent residual U-Net (referred to as recurrent R-U-Net), consists of 3D convolutional and recurrent (convLSTM) neural networks, designed to capture the spatial-temporal information associated with dynamic subsurface flow systems. A CNN-PCA procedure (convolutional neural network post-processing of principal component analysis) for parameterizing complex 3D geomodels is also described. This approach represents a simplified version of a recently developed supervised-learning-based CNN-PCA framework. The recurrent R-U-Net is trained on the simulated dynamic 3D saturation and pressure fields for a set of random `channelized' geomodels (generated using 3D CNN-PCA). Detailed flow predictions demonstrate that the recurrent R-U-Net surrogate model provides accurate results for dynamic states and well responses for new geological realizations, along with accurate flow statistics for an ensemble of new geomodels. The 3D recurrent R-U-Net and CNN-PCA procedures are then used in combination for a challenging data assimilation problem involving a channelized system. Two different algorithms, namely rejection sampling and an ensemble-based method, are successfully applied. The overall methodology described in this paper may enable the assessment and refinement of data assimilation procedures for a range of realistic and challenging subsurface flow problems.


title: Fibonacci topological phase in arrays of anyonic chains

abstract: Fibonacci anyon, an exotic quasi-particle excitation, plays a pivotal role in realization of a quantum computer. Starting from a $SU(2)_4$ topological phase, in this paper we demonstrate a way to construct a Fibonacci topological phase which has only one non-trivial excitation described by the Fibonacci anyon. We show that arrays of anyonic chains created by excitations of the $SU(2)_4$ phase leads to the Fibonacci phase. We further demonstrate that our theoretical propositions can be extended to other topological phases.


title: General properties of $\mathbf {f(R)}$ gravity vacuum solutions

abstract: General properties of vacuum solutions of $f(R)$ gravity are obtained by the condition that the divergence of the Weyl tensor is zero and $f''\neq 0$. Specifically, a theorem states that the gradient of the curvature scalar, $\nabla R$, is an eigenvector of the Ricci tensor and, if it is time-like, the space-time is a Generalized Friedman-Robertson-Walker metric; in dimension four, it is Friedman-Robertson-Walker.


title: Second Post-Minkowskian Metric for a Moving Kerr Black Hole

abstract: The harmonic metric for a moving Kerr black hole is presented in the second post-Minkowskian approximation. It is further demonstrated that the obtained metric is consistent with the Li\'{e}nard-Wiechert gravitational potential for a moving and spinning source with an arbitrary constant velocity. Based on the metric, we also give the post-Newtonian equations of motion for photon and massive test particle in the time-dependent gravitational field.


title: On the l.c.m. of shifted Fibonacci numbers

abstract: Let $(F_n)_{n \geq 1}$ be the sequence of Fibonacci numbers. Guy and Matiyasevich proved that \begin{equation*} \log \operatorname{lcm} (F_1, F_2, \dots, F_n) \sim \frac{3 \log \alpha}{\pi^2} \cdot n^2 \quad \text{as } n \to +\infty, \end{equation*} where $\operatorname{lcm}$ is the least common multiple and $\alpha := \big(1 + \sqrt{5}) / 2$ is the golden ratio. We prove that for every periodic sequence $\mathbf{s} = (s_n)_{n \geq 1}$ in $\{-1,+1\}$ there exists an effectively computable rational number $C_{\mathbf{s}} > 0$ such that \begin{equation*} \log \operatorname{lcm} (F_3 + s_3, F_4 + s_4, \dots, F_n + s_n) \sim \frac{3 \log \alpha}{\pi^2} \cdot C_\mathbf{s} \cdot n^2 , \quad \text{as } n \to +\infty . \end{equation*} Moreover, we show that if $(s_n)_{n \geq 1}$ is a sequence of independent uniformly distributed random variables in $\{-1,+1\}$ then \begin{equation*} \mathbb{E}\big[\log \operatorname{lcm} (F_3 + s_3, F_4 + s_4, \dots, F_n + s_n)\big] \sim \frac{3 \log \alpha}{\pi^2} \cdot \frac{15 \operatorname{Li}_2(1 / 16)}{2} \cdot n^2 , \quad \text{as } n \to +\infty , \end{equation*} where $\operatorname{Li}_2$ is the dilogarithm function.


title: Trojan horse method as surrogate indirect approach to study resonant reactions in nuclear astrophysics

abstract: We review the Trojan horse method and its applications to resonant reactions in nuclear astrophysics.


title: Few-shot Knowledge Transfer for Fine-grained Cartoon Face Generation

abstract: In this paper, we are interested in generating fine-grained cartoon faces for various groups. We assume that one of these groups consists of sufficient training data while the others only contain few samples. Although the cartoon faces of these groups share similar style, the appearances in various groups could still have some specific characteristics, which makes them differ from each other. A major challenge of this task is how to transfer knowledge among groups and learn group-specific characteristics with only few samples. In order to solve this problem, we propose a two-stage training process. First, a basic translation model for the basic group (which consists of sufficient data) is trained. Then, given new samples of other groups, we extend the basic model by creating group-specific branches for each new group. Group-specific branches are updated directly to capture specific appearances for each group while the remaining group-shared parameters are updated indirectly to maintain the distribution of intermediate feature space. In this manner, our approach is capable to generate high-quality cartoon faces for various groups.


title: Covert Identification over Binary-Input Discrete Memoryless Channels

abstract: This paper considers the covert identification problem in which a sender aims to reliably convey an identification (ID) message to a set of receivers via a binary-input discrete memoryless channel (BDMC), and simultaneously to guarantee that the communication is covert with respect to a warden who monitors the communication via another independent BDMC. We prove a square-root law for the covert identification problem. This states that an ID message of size \exp(\exp(\Theta(\sqrt{n}))) can be transmitted over n channel uses. We then characterize the exact pre-constant in the \Theta(.) notation. This constant is referred to as the covert identification capacity. We show that it equals the recently developed covert capacity in the standard covert communication problem, and somewhat surprisingly, the covert identification capacity can be achieved without any shared key between the sender and receivers. The achievability proof relies on a random coding argument with pulse-position modulation (PPM), coupled with a second stage which performs code refinements. The converse proof relies on an expurgation argument as well as results for channel resolvability with stringent input constraints.


title: Modular invariance in finite temperature Casimir effect

abstract: The temperature inversion symmetry of the partition function of the electromagnetic field in the set-up of the Casimir effect is extended to full modular transformations by turning on a purely imaginary chemical potential for adapted spin angular momentum. The extended partition function is expressed in terms of a real analytic Eisenstein series. These results become transparent after explicitly showing equivalence of the partition functions for Maxwell's theory between perfectly conducting parallel plates and for a massless scalar with periodic boundary conditions.


title: Overestimated isomer depletion due to contamination

abstract: The recent paper by Chiara et al. provided the first experimental evidence of nuclear excitation by electron capture (NEEC), responding a long-standing theoretical prediction. NEEC was inferred to be the main channel to excite an isomer in Molybdenum-93 to a higher state, leading to a rapid release of full isomer energy (isomer depletion). The deduced large excitation probability $P_{exc}$=0.010(3) for this mechanism implied strong influence on the survival of nuclei in stellar environments. However, the excitation probability is much higher than the estimated NEEC probability $P_{NEEC}$ according to a following theoretical work by approximately 9 orders of magnitude. Nevertheless, the reported $P_{exc}$ is predicted to be due to other unknown mechanism causing isomer depletion, which is expected to open up a new era of the storage and release of nuclear energy. Here we report an analysis of the reported experimental results, showing that the observed isomer depletion is significantly overestimated due to the contamination.


title: Simulating hadron test beams in liquid argon

abstract: Thorough modeling of the physics involved in liquid argon calorimetry is essential for accurately predicting the performance of DUNE and optimizing its design and analysis pipeline. At the fundamental level, it is essential to quantify the detector response to individual hadrons---protons, charged pions, and neutrons---at different injection energies. We report such a simulation, analyzed under different assumptions about event reconstruction, such as particle identification and neutron detection. The role of event containment is also quantified. The results of this simulation can help inform the ProtoDUNE test-beam data analysis, while also providing a framework for assessing the impact of various cross section uncertainties.


title: Classical Nova Persei 2018 outburst from the dwarf nova V392 Per

abstract: On 2018, April 29, a bright classical nova (CN) Per 2018 was discovered. Its progenitor is a well-known dwarf nova V392 Per. In this contribution, we analyze $UBVR_{C}I_{C}$ photometry and optical spectroscopy of the CN V392 Per. From the $V$ light curve (LC) we found the brightness decline times t$_{2,V}$ = 3 d, t$_{3,V}$ = 10 d and calculated absolute magnitude of the nova at maximum $MV_{max}$ = -9.30 ${\pm}$0.57 using the new $MV_{max}$ - t$_{3}$ "universal" decline law and $MV_{15}$ relations, adopting the Gaia data for CNe. We determined the colour excess $E_{B-V}$ = 0.90$\pm$0.09 and distance to the nova $d$ = 3.55$\pm$0.6 kpc. The optical spectrum obtained in brightness maximum resembles that of the F2 supergiant. Its bolometric luminosity computed by fitting the continuum by atmospheric and black-body models is in agreement with the luminosity, that we have found from photometry. We estimated the mass of the ONe white dwarf in V392 Per as $M_{wd}$ = 1.21 M$_{\odot}$. The CN Per 2018 can be classified as a fast super-Eddington nova with an outburst LC of plateau type. Nova displayed He/N spectrum classification, large expansion velocities, and triple-peaked emission-line profiles during the decline, explained by equatorial ring seen nearly face on and a bipolar flow aligned almost with the line of sight. The post maximum spectra of CN Per 2018 and available radio data were used to estimate the inclination angle of the system as $i\sim$ 9$^{\circ}$. The difference in intensity of redward and blueward emission bumps is possible to explain by about 1.5 times higher density of the receding outtflow. The rapid increase of the bipolar outflow radial velocities by $\sim$300 km/s around day 5 after the maximum was caused by the fast bipolar winds from the burning white dwarf after shrinking of its pseudophotosphere.


title: Unravelling a Zigzag Pathway for Hot-Carrier Collection at CH3NH3PbI3/Graphene Interfaces

abstract: The capture of photoexcited deep-band hot carriers, excited by photons with energies far above the bandgap, is of significant importance for photovoltaic and photoelectronic applications since it is directly related to the quantum efficiency of photon-to-electron conversion. By employing time-resolved photoluminescence and state-of-the-art time-domain density functional theory, we reveal that photoexcited hot carriers in organic-inorganic hybrid perovskites prefer a zigzag interfacial charge-transfer pathway, i.e., the hot carriers transfer back and forth between CH3NH3PbI3 and graphene, before they reach a charge separated state. Driven by quantum coherence and interlayer vibrational modes, this pathway at the semiconductor-graphene interface takes about 400 femtoseconds, much faster than the relaxation process within CH3NH3PbI3 (in several picoseconds). We further demonstrate that the transfer rate of the pathway can be further enhanced by interfacial defects. Our work provides a new insight for the fundamental understanding and precise manipulation of hot-carrier dynamics at the complex semiconductor-graphene interfaces, paving the way for highly efficient photovoltaic and photoelectric device optimization.


title: NAYEL at SemEval-2020 Task 12: TF/IDF-Based Approach for Automatic Offensive Language Detection in Arabic Tweets

abstract: In this paper, we present the system submitted to "SemEval-2020 Task 12". The proposed system aims at automatically identify the Offensive Language in Arabic Tweets. A machine learning based approach has been used to design our system. We implemented a linear classifier with Stochastic Gradient Descent (SGD) as optimization algorithm. Our model reported 84.20%, 81.82% f1-score on development set and test set respectively. The best performed system and the system in the last rank reported 90.17% and 44.51% f1-score on test set respectively.


title: Some applications of Wright functions in fractional differential equations

abstract: In this note we prove some new results about the application of Wright functions of the first kind to solve fractional differential equations with variable coefficients. Then, we consider some applications of these results in order to obtain some new particular solutions for nonlinear fractional partial differential equations.


title: Higher order normal modes

abstract: Normal modes are intimately related to the quadratic approximation of a potential at its hyperbolic equilibria. Here we extend the notion to the case where the Taylor expansion for the potential at a critical point starts with higher order terms, and show that such an extension shares some of the properties of standard normal modes. Some symmetric examples are considered in detail.


title: Nearest Neighbor distributions: new statistical measures for cosmological clustering

abstract: The use of summary statistics beyond the two-point correlation function to analyze the non-Gaussian clustering on small scales is an active field of research in cosmology. In this paper, we explore a set of new summary statistics -- the $k$-Nearest Neighbor Cumulative Distribution Functions ($k{\rm NN}$-${\rm CDF}$). This is the empirical cumulative distribution function of distances from a set of volume-filling, Poisson distributed random points to the $k$-nearest data points, and is sensitive to all connected $N$-point correlations in the data. The $k{\rm NN}$-${\rm CDF}$ can be used to measure counts in cell, void probability distributions and higher $N$-point correlation functions, all using the same formalism exploiting fast searches with spatial tree data structures. We demonstrate how it can be computed efficiently from various data sets - both discrete points, and the generalization for continuous fields. We use data from a large suite of $N$-body simulations to explore the sensitivity of this new statistic to various cosmological parameters, compared to the two-point correlation function, while using the same range of scales. We demonstrate that the use of $k{\rm NN}$-${\rm CDF}$ improves the constraints on the cosmological parameters by more than a factor of $2$ when applied to the clustering of dark matter in the range of scales between $10h^{-1}{\rm Mpc}$ and $40h^{-1}{\rm Mpc}$. We also show that relative improvement is even greater when applied on the same scales to the clustering of halos in the simulations at a fixed number density, both in real space, as well as in redshift space. Since the $k{\rm NN}$-${\rm CDF}$ are sensitive to all higher order connected correlation functions in the data, the gains over traditional two-point analyses are expected to grow as progressively smaller scales are included in the analysis of cosmological data.


title: Formation of mass gap compact object and black hole binary from Population III stars

abstract: We performed population synthesis simulations of Population III binary stars with Maxwellian kick velocity distribution when MGCOs (Mass Gap Compact Objects with mass 2--5$\,M_{\odot}$) are formed. We found that for eight kick velocity dispersion models of $\sigma_{\rm k}=0$--$500$ km/s, the mean mass of black hole (BH)-MGCO binary is $\sim (30 \,M_\odot,\,2.6 \,M_\odot)$. In numerical data of our simulations, we found the existence of BH-MGCO binary with mass $(22.9 \,M_\odot,\,2.5 \,M_\odot)$ which looks like GW190814.


title: Self-Prediction for Joint Instance and Semantic Segmentation of Point Clouds

abstract: We develop a novel learning scheme named Self-Prediction for 3D instance and semantic segmentation of point clouds. Distinct from most existing methods that focus on designing convolutional operators, our method designs a new learning scheme to enhance point relation exploring for better segmentation. More specifically, we divide a point cloud sample into two subsets and construct a complete graph based on their representations. Then we use label propagation algorithm to predict labels of one subset when given labels of the other subset. By training with this Self-Prediction task, the backbone network is constrained to fully explore relational context/geometric/shape information and learn more discriminative features for segmentation. Moreover, a general associated framework equipped with our Self-Prediction scheme is designed for enhancing instance and semantic segmentation simultaneously, where instance and semantic representations are combined to perform Self-Prediction. Through this way, instance and semantic segmentation are collaborated and mutually reinforced. Significant performance improvements on instance and semantic segmentation compared with baseline are achieved on S3DIS and ShapeNet. Our method achieves state-of-the-art instance segmentation results on S3DIS and comparable semantic segmentation results compared with state-of-the-arts on S3DIS and ShapeNet when we only take PointNet++ as the backbone network.


title: Decoupled Water Splitting: From Basic Science to Application

abstract: In this review, we discuss disruptive decoupled water splitting schemes, in which the concurrent production of hydrogen and oxygen in close proximity to each other in conventional electrolysis is replaced by time- or space-separated hydrogen and oxygen production steps. We present the main decoupling strategies, including electrolytic and electrochemical chemical water splitting cycles, and the redox materials that facilitate them by mediating the ion exchange between the hydrogen and oxygen evolution reactions. Decoupled water splitting offers increased flexibility and robustness and provides new opportunities for hydrogen production from renewable sources.


title: Karl Marx and the Blockchain

abstract: Blockchain is often presented as a technological development; however, clearly it is not only that: the `Blockchain buzz' exists in the context of current social and political developments. In this essay, we analyse blockchain technology and its social and political context from a perspective of Marxist economic theory. Since arguably the last great inflection point in society and technology was analysed by Marx in terms of labour and capital and since we seem to be experiencing a shift in the balance between these forces today, it makes sense to revisit the Marxist ideas and apply them to the current situation, to see how well they still apply and if necessary to update them for current events.


title: Transformations of Moment Functionals

abstract: In measure theory several results are known how measure spaces are transformed into each other. But since moment functionals are represented by a measure we investigate in this study the effects and implications of these measure transformations to moment funcationals. We gain characterizations of moments functionals. Among other things we show that for a compact and path connected set $K\subset\mathbb{R}^n$ there exists a measurable function $g:K\to [0,1]$ such that any linear functional $L:\mathbb{R}[x_1,\dots,x_n]\to\mathbb{R}$ is a $K$-moment functional if and only if it has a continuous extension to some $\overline{L}:\mathbb{R}[x_1,\dots,x_n]+\mathbb{R}[g]\to\mathbb{R}$ such that $\tilde{L}:\mathbb{R}[t]\to\mathbb{R}$ defined by $\tilde{L}(t^d) := \overline{L}(g^d)$ for all $d\in\mathbb{N}_0$ is a $[0,1]$-moment functional (Hausdorff moment problem). Additionally, there exists a continuous function $f:[0,1]\to K$ independent on $L$ such that the representing measure $\tilde{\mu}$ of $\tilde{L}$ provides the representing measure $\tilde{\mu}\circ f^{-1}$ of $L$. We also show that every moment functional $L:\mathcal{V}\to\mathbb{R}$ is represented by $\lambda\circ f^{-1}$ for some measurable function $f:[0,1]\to\mathbb{R}^n$ where $\lambda$ is the Lebesgue on $[0,1]$.


title: Good Practice Guide on the electrical characterisation of graphene using contact methods

abstract: This guide is a deliverable of the Joint Research Project 16NRM01 GRACE -- Developing electrical characterisation methods for future graphene electronics. The project belongs to the European Metrology Programme for Innovation and Research (EMPIR). GRACE is framed within the Normative targeted program, and its overall goal is (1) the development of validated protocols for the measurement of the electrical properties of graphene, and their implementation in order to achieve accurate and fastthroughput measurement of graphene; and (2) the collaboration with international standardisation committees in order to initiate and develop dedicated documentary standards for the electrical characterisation of graphene. The adoption of this GPGs and, when published, the corresponding standards, will allow industry to perform accurate measurements of the electrical properties of graphene and thereby provide customers with reliable and comparable specifications of graphene as an industrial product.


title: Slowly varying asymptotics for signed stochastic difference equations

abstract: For a stochastic difference equation $D_n=A_nD_{n-1}+B_n$ which stabilises upon time we study tail distribution asymptotics of $D_n$ under the assumption that the distribution of $\log(1+|A_1|+|B_1|)$ is heavy-tailed, that is, all its positive exponential moments are infinite. The aim of the present paper is three-fold. Firstly, we identify the asymptotic behaviour not only of the stationary tail distribution but also of $D_n$. Secondly, we solve the problem in the general setting when $A$ takes both positive and negative values. Thirdly, we get rid of auxiliary conditions like finiteness of higher moments used in the literature before.


title: Self-Attentive Multi-Layer Aggregation with Feature Recalibration and Normalization for End-to-End Speaker Verification System

abstract: One of the most important parts of an end-to-end speaker verification system is the speaker embedding generation. In our previous paper, we reported that shortcut connections-based multi-layer aggregation improves the representational power of the speaker embedding. However, the number of model parameters is relatively large and the unspecified variations increase in the multi-layer aggregation. Therefore, we propose a self-attentive multi-layer aggregation with feature recalibration and normalization for end-to-end speaker verification system. To reduce the number of model parameters, the ResNet, which scaled channel width and layer depth, is used as a baseline. To control the variability in the training, a self-attention mechanism is applied to perform the multi-layer aggregation with dropout regularizations and batch normalizations. Then, a feature recalibration layer is applied to the aggregated feature using fully-connected layers and nonlinear activation functions. Deep length normalization is also used on a recalibrated feature in the end-to-end training process. Experimental results using the VoxCeleb1 evaluation dataset showed that the performance of the proposed methods was comparable to that of state-of-the-art models (equal error rate of 4.95% and 2.86%, using the VoxCeleb1 and VoxCeleb2 training datasets, respectively).


title: A Simple and Interpretable Predictive Model for Healthcare

abstract: Deep Learning based models are currently dominating most state-of-the-art solutions for disease prediction. Existing works employ RNNs along with multiple levels of attention mechanisms to provide interpretability. These deep learning models, with trainable parameters running into millions, require huge amounts of compute and data to train and deploy. These requirements are sometimes so huge that they render usage of such models as unfeasible. We address these challenges by developing a simpler yet interpretable non-deep learning based model for application to EHR data. We model and showcase our work's results on the task of predicting first occurrence of a diagnosis, often overlooked in existing works. We push the capabilities of a tree based model and come up with a strong baseline for more sophisticated models. Its performance shows an improvement over deep learning based solutions (both, with and without the first-occurrence constraint) all the while maintaining interpretability.


title: Algorithm Configurations of MOEA/D with an Unbounded External Archive

abstract: In the evolutionary multi-objective optimization (EMO) community, it is usually assumed that the final population is presented to the decision maker as the result of the execution of an EMO algorithm. Recently, an unbounded external archive was used to evaluate the performance of EMO algorithms in some studies where a pre-specified number of solutions are selected from all the examined non-dominated solutions. In this framework, which is referred to as the solution selection framework, the final population does not have to be a good solution set. Thus, the solution selection framework offers higher flexibility to the design of EMO algorithms than the final population framework. In this paper, we examine the design of MOEA/D under these two frameworks. First, we show that the performance of MOEA/D is improved by linearly changing the reference point specification during its execution through computational experiments with various combinations of initial and final specifications. Robust and high performance of the solution selection framework is observed. Then, we examine the use of a genetic algorithm-based offline hyper-heuristic method to find the best configuration of MOEA/D in each framework. Finally, we further discuss solution selection after the execution of an EMO algorithm in the solution selection framework.


title: Reaching small scales with low frequency imaging: applications to the Dark Ages

abstract: The initial conditions for the density perturbations in the early Universe, which dictate the large scale structure and distribution of galaxies we see today, are set during inflation. Measurements of primordial non-Gaussianity are crucial for distinguishing between different inflationary models. Current measurements of the matter power spectrum from the CMB only constrain this on scales up to $k\sim 0.1$ Mpc$^{-1}$. Reaching smaller angular scales (higher values of $k$) can provide new constraints on non-Gaussianity. A powerful way to do this is by measuring the $\textrm{H}\textrm{I}$ matter power spectrum at $z\gtrsim30$. In this paper, we investigate what values of $k$ can be reached for the LOw Frequency ARray (LOFAR), which can achieve $\lesssim$1$''$ $\,$resolution at $\sim$50 MHz. Combining this with a technique to isolate the spectrally smooth foregrounds to a wedge in $k_{\parallel}$ - $k_{\perp}$ space, we demonstrate what values of $k$ we can feasibly reach within observational constraints. We find that LOFAR is $\sim$5 orders of magnitude away from the desired sensitivity, for 10 years of integration time.


title: Feature visualization of Raman spectrum analysis with deep convolutional neural network

abstract: We demonstrate a recognition and feature visualization method that uses a deep convolutional neural network for Raman spectrum analysis. The visualization is achieved by calculating important regions in the spectra from weights in pooling and fully-connected layers. The method is first examined for simple Lorentzian spectra, then applied to the spectra of pharmaceutical compounds and numerically mixed amino acids. We investigate the effects of the size and number of convolution filters on the extracted regions for Raman-peak signals using the Lorentzian spectra. It is confirmed that the Raman peak contributes to the recognition by visualizing the extracted features. A near-zero weight value is obtained at the background level region, which appears to be used for baseline correction. Common component extraction is confirmed by an evaluation of numerically mixed amino acid spectra. High weight values at the common peaks and negative values at the distinctive peaks appear, even though the model is given one-hot vectors as the training labels (without a mix ratio). This proposed method is potentially suitable for applications such as the validation of trained models, ensuring the reliability of common component extraction from compound samples for spectral analysis.


title: Ultrafast triggering of insulator-metal transition in two-dimensional VSe$_2$

abstract: Assembling transition metal dichalcogenides (TMDCs) at the two-dimensional (2D) limit is a promising approach for tailoring emerging states of matter such as superconductivity or charge density waves (CDWs). Single-layer (SL) VSe$_2$ stands out in this regard because it exhibits a strongly enhanced CDW transition with a higher transition temperature compared to the bulk in addition to an insulating phase with an anisotropic gap at the Fermi level, causing a suppression of anticipated 2D ferromagnetism in the material. Here, we investigate the interplay of electronic and lattice degrees of freedom that underpin these electronic phases in SL VSe$_2$ using ultrafast pump-probe photoemission spectroscopy. In the insulating state, we observe a light-induced closure of the energy gap on a timescale of 480 fs, which we disentangle from the ensuing hot carrier dynamics. Our work thereby reveals that the phase transition in SL VSe$_2$ is driven by electron-lattice coupling and demonstrates the potential for controlling electronic phases in 2D materials with light.


title: Optimal construction of a layer-ordered heap

abstract: The layer-ordered heap (LOH) is a simple, recently proposed data structure used in optimal selection on $X+Y$, thealgorithm with the best known runtime for selection on $X_1+X_2+\cdots+X_m$, and the fastest method in practice for computing the most abundant isotope peaks in a chemical compound. Here, we introduce a few algorithms for constructing LOHs, analyze their complexity, and demonstrate that one algorithm is optimal for building a LOH of any rank $\alpha$. These results are shown to correspond with empirical experiments of runtimes when applying the LOH construction algorithms to a common task in machine learning.


title: Asymptotic and Quenching Behavior for a family of Parabolic System with General Singular Nonlinearities

abstract: This study is concerned with a family of parabolic system with general singular nonlinearities, which is a generalization of MEMS system. To some extent, the classification of global existence and quenching according to parameters and initial data is given. Moreover, the convergence rate is also obtained. We point out that compared to single MEMS equation, new ideas and techniques are introduced in obtaining the convergence rate for system in our study. In fact, due to the lack of variational characterization for the first eigenvalue of the linearized elliptic system, the methods in obtaining convergence rate for single equation cannot work completely here.