title: Oxygen Hole Formation Controls Stability in LiNiO$_2$ Cathodes: DFT Studies of Oxygen Loss and Singlet Oxygen Formation in Li-Ion Batteries

abstract: Ni-rich cathode materials achieve both high voltages and capacities in Li-ion batteries but are prone to structural instabilities and oxygen loss via the formation of singlet oxygen. Using ab initio molecular dynamics simulations, we observe spontaneous O$_2$ loss from the (012) surface of delithiated LiNiO$_2$, singlet oxygen forming in the process. We find that the origin of the instability lies in the pronounced oxidation of O during delithiation, i.e., O plays a central role in Ni O redox in LiNiO$_2$. For LiNiO$_2$, NiO$_2$, and the prototype rock salt NiO, density-functional theory and dynamical mean-field theory calculations based on maximally localised Wannier functions yield a Ni charge state of ca. +2, with O varying between -2 (NiO), -1.5 (LiNiO$_2$) and -1 (NiO$_2$). Predicted XAS Ni $K$ and O $K$-edge spectra are in excellent agreement with experimental XAS spectra, confirming the predicted charge states. The calculations also show that a high-voltage O $K$-edge feature at 531 eV previously assigned to lattice O-redox processes could alternatively arise from O-redox induced water intercalation and O-O dimer formation with lattice O at high states of charge. The O$_2$ surface loss route observed here consists of 2 surface O$^{.-}$ radicals combining to form a peroxide ion, which is oxidised to O$_2$, leaving behind 2 O vacancies and 2 O$^{2-}$ ions: effectively 4 O$^{.-}$ radicals disproportionate to O$_2$ and 2 O$^{2-}$ ions. The reaction liberates ca. 3 eV per O$_2$ molecule. Singlet oxygen formation is caused by the singlet ground state of the peroxide ion, with spin conservation dictating the preferential release of $^1$O$_2$, the strongly exergonic reaction providing the free energy required for the formation of $^1$O$_2$ in its excited state.


title: Glaberish: Generalizing the continuously-valued Lenia framework to arbitrary Life-like cellular automata

abstract: Recent work with Lenia, a continuously-valued cellular automata (CA) framework, has yielded $\sim$100s of compelling, bioreminiscent and mobile patterns. Lenia can be viewed as a continuously-valued generalization of the Game of Life, a seminal cellular automaton developed by John Conway that exhibits complex and universal behavior based on simple birth and survival rules. Life's framework of totalistic CA based on the Moore neighborhood includes many other interesting, Life-like, CA. A simplification introduced in Lenia limits the types of Life-like CA that are expressible in Lenia to a specific subset. This work recovers the ability to easily implement any Life-like CA by splitting Lenia's growth function into genesis and persistence functions, analogous to Life's birth and survival rules. We demonstrate the capabilities of this new CA variant by implementing a puffer pattern from Life-like CA Morley/Move, and examine differences between related CA in Lenia and Glaberish frameworks: Hydrogeminium natans and s613, respectively. These CA exhibit marked differences in dynamics and character based on spatial entropy over time, and both support several persistent mobile patterns. The CA s613, implemented in the Glaberish framework, is more dynamic than the Hydrogeminium CA in terms of a consistently high variance in spatial entropy over time. These results suggest there may be a wide variety of interesting CA that can be implemented in the Glaberish variant of the Lenia framework, analogous to the many interesting Life-like CA outside of Conway's Life.


title: Synthesis from Satisficing and Temporal Goals

abstract: Reactive synthesis from high-level specifications that combine hard constraints expressed in Linear Temporal Logic LTL with soft constraints expressed by discounted-sum (DS) rewards has applications in planning and reinforcement learning. An existing approach combines techniques from LTL synthesis with optimization for the DS rewards but has failed to yield a sound algorithm. An alternative approach combining LTL synthesis with satisficing DS rewards (rewards that achieve a threshold) is sound and complete for integer discount factors, but, in practice, a fractional discount factor is desired. This work extends the existing satisficing approach, presenting the first sound algorithm for synthesis from LTL and DS rewards with fractional discount factors. The utility of our algorithm is demonstrated on robotic planning domains.


title: Thermal Conductivity of an Ultracold Paramagnetic Bose Gas

abstract: We analytically derive the transport tensor of thermal conductivity in an ultracold, but not yet quantum degenerate, gas of Bosonic lanthanide atoms using the Chapman-Enskog procedure. The tensor coefficients inherit an anisotropy from the anisotropic collision cross section for these dipolar species, manifest in their dependence on the dipole moment, dipole orientation, and $s$-wave scattering length. These functional dependencies open up a pathway for control of macroscopic gas phenomena via tuning of the microscopic atomic interactions. As an illustrative example, we analyze the time evolution of a temperature hot-spot which shows preferential heat diffusion orthogonal to the dipole orientation, a direct consequence of anisotropic thermal conduction.


title: A Survey on Physiological Signal Based Emotion Recognition

abstract: Physiological Signals are the most reliable form of signals for emotion recognition, as they cannot be controlled deliberately by the subject. Existing review papers on emotion recognition based on physiological signals surveyed only the regular steps involved in the workflow of emotion recognition such as preprocessing, feature extraction, and classification. While these are important steps, such steps are required for any signal processing application. Emotion recognition poses its own set of challenges that are very important to address for a robust system. Thus, to bridge the gap in the existing literature, in this paper, we review the effect of inter-subject data variance on emotion recognition, important data annotation techniques for emotion recognition and their comparison, data preprocessing techniques for each physiological signal, data splitting techniques for improving the generalization of emotion recognition models and different multimodal fusion techniques and their comparison. Finally we discuss key challenges and future directions in this field.


title: Understanding the Risks and Rewards of Combining Unbiased and Possibly Biased Estimators, with Applications to Causal Inference

abstract: Several problems in statistics involve the combination of high-variance unbiased estimators with low-variance estimators that are only unbiased under strong assumptions. A notable example is the estimation of causal effects while combining small experimental datasets with larger observational datasets. There exist a series of recent proposals on how to perform such a combination, even when the bias of the low-variance estimator is unknown. To build intuition for the differing trade-offs of competing approaches, we argue for examining the finite-sample estimation error of each approach as a function of the unknown bias. This includes understanding the bias threshold -- the largest bias for which a given approach improves over using the unbiased estimator alone. Though this lens, we review several recent proposals, and observe in simulation that different approaches exhibits qualitatively different behavior. We also introduce a simple alternative approach, which compares favorably in simulation to recent alternatives, having a higher bias threshold and generally making a more conservative trade-off between best-case performance (when the bias is zero) and worst-case performance (when the bias is adversarially chosen). More broadly, we prove that for any amount of (unknown) bias, the MSE of this estimator can be bounded in a transparent way that depends on the variance / covariance of the underlying estimators that are being combined.


title: Deep Learning for Omnidirectional Vision: A Survey and New Perspectives

abstract: Omnidirectional image (ODI) data is captured with a 360x180 field-of-view, which is much wider than the pinhole cameras and contains richer spatial information than the conventional planar images. Accordingly, omnidirectional vision has attracted booming attention due to its more advantageous performance in numerous applications, such as autonomous driving and virtual reality. In recent years, the availability of customer-level 360 cameras has made omnidirectional vision more popular, and the advance of deep learning (DL) has significantly sparked its research and applications. This paper presents a systematic and comprehensive review and analysis of the recent progress in DL methods for omnidirectional vision. Our work covers four main contents: (i) An introduction to the principle of omnidirectional imaging, the convolution methods on the ODI, and datasets to highlight the differences and difficulties compared with the 2D planar image data; (ii) A structural and hierarchical taxonomy of the DL methods for omnidirectional vision; (iii) A summarization of the latest novel learning strategies and applications; (iv) An insightful discussion of the challenges and open problems by highlighting the potential research directions to trigger more research in the community.


title: Masterful: A Training Platform for Computer Vision Models

abstract: Masterful is a software platform to train deep learning computer vision models. Data and model architecture are inputs to the platform, and the output is a trained model. The platform's primary goal is to maximize a trained model's accuracy, which it achieves through its regularization and semi-supervised learning implementations. The platform's secondary goal is to minimize the amount of manual experimentation typically required to tune training hyperparameters, which it achieves via multiple metalearning algorithms which are custom built to control the platform's regularization and semi-supervised learning implementations. The platform's tertiary goal is to minimize the computing resources required to train a model, which it achieves via another set of metalearning algorithms which are purpose built to control Tensorflow's optimization implementations. The platform builds on top of Tensorflow's data management, architecture, automatic differentiation, and optimization implementations.


title: Circulation Statistics and the Mutually Excluding Behavior of Turbulent Vortex Structures

abstract: The small-scale statistical properties of velocity circulation in classical homogeneous and isotropic turbulent flows are assessed through a modeling framework that brings together the multiplicative cascade and the structural descriptions of turbulence. We find that vortex structures exhibit short-distance repulsive correlations, which is evidenced when they are "tomographically" investigated, by means of planar cuts of the flow, as two-dimensional vortex gases. This phenomenon is suggested from model improvements which allow us to obtain an accurate multiscale description of the intermittent fluctuations of circulation. Its crucial new ingredient, the conjectured hard disk behavior of the effective planar vortices, is then found to be strongly supported from a study of their spatial distributions in direct numerical simulations of the Navier-Stokes equations.


title: Retrieval-Augmented Multilingual Keyphrase Generation with Retriever-Generator Iterative Training

abstract: Keyphrase generation is the task of automatically predicting keyphrases given a piece of long text. Despite its recent flourishing, keyphrase generation on non-English languages haven't been vastly investigated. In this paper, we call attention to a new setting named multilingual keyphrase generation and we contribute two new datasets, EcommerceMKP and AcademicMKP, covering six languages. Technically, we propose a retrieval-augmented method for multilingual keyphrase generation to mitigate the data shortage problem in non-English languages. The retrieval-augmented model leverages keyphrase annotations in English datasets to facilitate generating keyphrases in low-resource languages. Given a non-English passage, a cross-lingual dense passage retrieval module finds relevant English passages. Then the associated English keyphrases serve as external knowledge for keyphrase generation in the current language. Moreover, we develop a retriever-generator iterative training algorithm to mine pseudo parallel passage pairs to strengthen the cross-lingual passage retriever. Comprehensive experiments and ablations show that the proposed approach outperforms all baselines.


title: A Simple Characterization of Supply Correspondences

abstract: We prove that supply correspondences are characterized by two properties: the law of supply and being homogeneous of degree zero.


title: De novo design of protein target specific scaffold-based Inhibitors via Reinforcement Learning

abstract: Efficient design and discovery of target-driven molecules is a critical step in facilitating lead optimization in drug discovery. Current approaches to develop molecules for a target protein are intuition-driven, hampered by slow iterative design-test cycles due to computational challenges in utilizing 3D structural data, and ultimately limited by the expertise of the chemist - leading to bottlenecks in molecular design. In this contribution, we propose a novel framework, called 3D-MolGNN$_{RL}$, coupling reinforcement learning (RL) to a deep generative model based on 3D-Scaffold to generate target candidates specific to a protein building up atom by atom from the starting core scaffold. 3D-MolGNN$_{RL}$ provides an efficient way to optimize key features by multi-objective reward function within a protein pocket using parallel graph neural network models. The agent learns to build molecules in 3D space while optimizing the activity, binding affinity, potency, and synthetic accessibility of the candidates generated for infectious disease protein targets. Our approach can serve as an interpretable artificial intelligence (AI) tool for lead optimization with optimized activity, potency, and biophysical properties.


title: Infinite bound states and hydrogen atom-like energy spectrum induced by a flat band

abstract: In this work, we investigate the bound state problem in one dimensional spin-1 Dirac Hamiltonian with a flat band. It is found that, the flat band has significant effects on the bound states. For example, for Dirac delta potential $g\delta(x)$, there exists one bound state for both positive and negative potential strength $g$. Furthermore, when the potential is weak, the bound state energy is proportional to the potential strength $g$. For square well potential, the flat band results in the existence of infinite bound states for arbitrarily weak potential. In addition, when the bound state energy is very near the flat band, the energy displays hydrogen atom-like spectrum, i.e., the bound state energies are inversely proportional to the square of natural number $n$ (e.g., $E_n\propto 1/n^2, n=1,2,3,...$). Most of the above nontrivial behaviors can be attributed to the infinitely large density of states of flat band and its ensuing $1/z$ singularity of Green function. The combination of a short-ranged potential and flat band provides a new possibility to get infinite number of bound states and hydrogen atom-like energy spectrum. In addition, our findings would provide some useful insights in the understanding of many-body physics of flat band.


title: DeepStruct: Pretraining of Language Models for Structure Prediction

abstract: We introduce a method for improving the structural understanding abilities of language models. Unlike previous approaches that finetune the models with task-specific augmentation, we pretrain language models on a collection of task-agnostic corpora to generate structures from text. Our structure pretraining enables zero-shot transfer of the learned knowledge that models have about the structure tasks. We study the performance of this approach on 28 datasets, spanning 10 structure prediction tasks including open information extraction, joint entity and relation extraction, named entity recognition, relation classification, semantic role labeling, event extraction, coreference resolution, factual probe, intent detection, and dialogue state tracking. We further enhance the pretraining with the task-specific training sets. We show that a 10B parameter language model transfers non-trivially to most tasks and obtains state-of-the-art performance on 21 of 28 datasets that we evaluate.


title: Topological quantum phase transition of nickelocene on Cu(100)

abstract: Local quantum phase transitions driven by Kondo correlations have been theoretically proposed in several magnetic nanosystems; however, clear experimental signatures are scant. Modeling a nickelocene molecule on a Cu(100) substrate as a two-orbital Anderson impurity with single-ion easy-plane anisotropy coupled to two conduction bands, we find that recent scanning tunneling spectra measured at different microscope tip heights reveal the existence of a topological quantum phase transition from the usual local Fermi liquid with high zero-bias conductance to a non-Landau Fermi liquid, characterized by a non-trivial quantized Luttinger integral, with a small conductance. The effects of intermediate valence, finite temperature, and structural relaxation of the molecule position allow us to explain the different observed behaviors.


title: Infinite bound states and $1/n$ energy spectrum induced by a Coulomb-like potential of type III in a flat band system

abstract: In this work, we investigate the bound states in a one-dimensional spin-1 flat band system with a Coulomb-like potential of type III, which has a unique non-vanishing matrix element in basis $|1\rangle$. It is found that, for such a kind of potential, there exists infinite bound states. Near the threshold of continuous spectrum, the bound state energy is consistent with the ordinary hydrogen-like atom energy level formula with Rydberg correction. In addition, the flat band has significant effects on the bound states. For example, there are infinite bound states which are generated from the flat band. Furthermore, when the potential is weak, the bound state energy is proportional to the Coulomb-like potential strength $\alpha$. When the bound state energies are very near the flat band, they are inversely proportional to the natural number $n$ (e.g., $E_n\propto 1/n, n=1,2,3,...$). Further we find that the energy spectrum can be well described by quasi-classical approximation (WKB method). Finally, we give a critical potential strength $\alpha_c$ at which the bound state energy reaches the threshold of continuous spectrum. \textbf{After crossing the threshold, the bound states in the continuum (BIC) may exist in such a flat band system.


title: Conditional Balance Tests: Increasing Sensitivity and Specificity With Prognostic Covariates

abstract: Researchers often use covariate balance tests to assess whether a treatment variable is assigned "as-if" at random. However, standard tests may shed no light on a key condition for causal inference: the independence of treatment assignment and potential outcomes. We focus on a key factor that affects the sensitivity and specificity of balance tests: the extent to which covariates are prognostic, that is, predictive of potential outcomes. We propose a "conditional balance test" based on the weighted sum of covariate differences of means, where the weights are coefficients from a standardized regression of observed outcomes on covariates. Our theory and simulations show that this approach increases power relative to other global tests when potential outcomes are imbalanced, while limiting spurious rejections due to imbalance on irrelevant covariates.


title: DEER: Descriptive Knowledge Graph for Explaining Entity Relationships

abstract: We propose DEER (Descriptive Knowledge Graph for Explaining Entity Relationships) - an open and informative form of modeling entity relationships. In DEER, relationships between entities are represented by free-text relation descriptions. For instance, the relationship between entities of machine learning and algorithm can be represented as ``Machine learning explores the study and construction of algorithms that can learn from and make predictions on data.'' To construct DEER, we propose a self-supervised learning method to extract relation descriptions with the analysis of dependency patterns and generate relation descriptions with a transformer-based relation description synthesizing model, where no human labeling is required. Experiments demonstrate that our system can extract and generate high-quality relation descriptions for explaining entity relationships. The results suggest that we can build an open and informative knowledge graph without human annotation.


title: $W$ mass in a model with vector-like leptons and $U(1)^\prime$

abstract: We study the effects of vector-like leptons on the $W$ boson mass in a model with a vector-like $U(1)^\prime$ gauge symmetry. This model provides simultaneous explanations for the recent anomalies in the muon anomalous magnetic moment and the semi-leptonic decays of $B$ mesons. We found that the recent result of the $W$ boson mass precise measurement at CDF can be explained if the charged (neutral) vector-like lepton is lighter than 250 (80) GeV. The light vector-like leptons may not be excluded by collider experiments if these decay to a physical mode of the $U(1)^\prime$ breaking scalar field.


title: Semi-Supervised Subspace Clustering via Tensor Low-Rank Representation

abstract: In this letter, we propose a novel semi-supervised subspace clustering method, which is able to simultaneously augment the initial supervisory information and construct a discriminative affinity matrix. By representing the limited amount of supervisory information as a pairwise constraint matrix, we observe that the ideal affinity matrix for clustering shares the same low-rank structure as the ideal pairwise constraint matrix. Thus, we stack the two matrices into a 3-D tensor, where a global low-rank constraint is imposed to promote the affinity matrix construction and augment the initial pairwise constraints synchronously. Besides, we use the local geometry structure of input samples to complement the global low-rank prior to achieve better affinity matrix learning. The proposed model is formulated as a Laplacian graph regularized convex low-rank tensor representation problem, which is further solved with an alternative iterative algorithm. In addition, we propose to refine the affinity matrix with the augmented pairwise constraints. Comprehensive experimental results on eight commonly-used benchmark datasets demonstrate the superiority of our method over state-of-the-art methods. The code is publicly available at https://github.com/GuanxingLu/Subspace-Clustering.


title: Analytic Gelfand-Shilov smoothing effect of the spatially homogeneous Landau equation

abstract: In this work, we study the nonlinear spatially homogeneous Landau equation with hard potential in a close-to-equilibrium framework, we show that the solution to the Cauchy problem with $L^2$ initial datum enjoys a analytic Gelfand-Shilov regularizing effect in the class $S^1_1(\mathbb{R}^3)$, meaning that the solution of the Cauchy problem and its Fourier transformation are analytic for any positive time, the evolution of analytic radius is similar to the heat equation.


title: Deep Reinforcement Learning Coordinated Receiver Beamforming for Millimeter-Wave Train-ground Communications

abstract: As more and more people choose high-speed rail (HSR) as a means of transportation for short trips, there is ever growing demand of high quality of multimedia services. With its rich spectrum resources, millimeter wave (mm-wave) communications can satisfy the high network capacity requirements for HSR. Also, it is possible for receivers (RXs) to be equipped with antenna arrays in mm-wave communication systems due to its short wavelength. However, as HSRs run with high speed, the received signal power (RSP) varies rapidly over a cell and it is the lowest at the edge of the cell compared to other locations. Consequently, it is necessary to conduct research on RX beamforming for HSR in mm-wave band to improve the quality of the received signal. In this paper, we focus on RX beamforming for a mm-wave train-ground communication system. To improve the RSP, we propose an effective RX beamforming scheme based on deep reinforcement learning (DRL), and develop a deep Q-network (DQN) algorithm to train and determine the optimal RX beam direction with the purpose of maximizing average RSP. Through extensive simulations, we demonstrate that the proposed scheme has better performance than the four baseline schemes in terms of average RSP at most positions on the railway.


title: Nuclear Norm Maximization Based Curiosity-Driven Learning

abstract: To handle the sparsity of the extrinsic rewards in reinforcement learning, researchers have proposed intrinsic reward which enables the agent to learn the skills that might come in handy for pursuing the rewards in the future, such as encouraging the agent to visit novel states. However, the intrinsic reward can be noisy due to the undesirable environment's stochasticity and directly applying the noisy value predictions to supervise the policy is detrimental to improve the learning performance and efficiency. Moreover, many previous studies employ $\ell^2$ norm or variance to measure the exploration novelty, which will amplify the noise due to the square operation. In this paper, we address aforementioned challenges by proposing a novel curiosity leveraging the nuclear norm maximization (NNM), which can quantify the novelty of exploring the environment more accurately while providing high-tolerance to the noise and outliers. We conduct extensive experiments across a variety of benchmark environments and the results suggest that NNM can provide state-of-the-art performance compared with previous curiosity methods. On 26 Atari games subset, when trained with only intrinsic reward, NNM achieves a human-normalized score of 1.09, which doubles that of competitive intrinsic rewards-based approaches. Our code will be released publicly to enhance the reproducibility.


title: Lepton flavor violating decays $l_j\rightarrow{l_i\gamma}$ in the $U(1)_X$SSM model within the Mass Insertion Approximation

abstract: Three singlet new Higgs superfields and right-handed neutrinos are added to MSSM to obtain $U(1)_X$SSM model. Its local gauge group is $SU(3)_C\times SU(2)_L \times U(1)_Y \times U(1)_X$. In the framework of $U(1)_X$SSM, we study muon anomalous magnetic moment and lepton flavor violating decays $l_j\rightarrow{l_i\gamma}(j=2,3;i=1,2)$ within the Mass Insertion Approximation(MIA). Through the MIA method, we can find the parameters that directly affect the analytical result of the lepton flavor violating decays $l_j\rightarrow{l_i\gamma}$, which make our work more convenient. We want to provide a set of simple analytic formulas for the form factors and the associated effective vertices, that may be very useful for future phenomenological studies of the lepton flavor violating decays. According to the accuracy of the numerical results which the influence of different sensitive parameters, we come to the conclusion that the non-diagonal elements which correspond to the generations of the initial lepton and final lepton are main sensitive parameters and lepton flavor violation(LFV) sources. This work can provide a clear signal of new physics(NP).


title: Multivariate generalized linear mixed models for underdispersed count data

abstract: Researchers are often interested in understanding the relationship between a set of covariates and a set of response variables. To achieve this goal, the use of regression analysis, either linear or generalized linear models, is largely applied. However, such models only allow users to model one response variable at a time. Moreover, it is not possible to directly calculate from the regression model a correlation measure between the response variables. In this article, we employed the Multivariate Generalized Linear Mixed Models framework, which allows the specification of a set of response variables and calculates the correlation between them through a random effect structure that follows a multivariate normal distribution. We used the maximum likelihood estimation framework to estimate all model parameters using Laplace approximation to integrate out the random effects. The derivatives are provided by automatic differentiation. The outer maximization was made using a general-purpose algorithm such as \texttt{PORT} and \texttt{BFGS}. We delimited this problem by studying only count response variables with the following distributions: Poisson, negative binomial (NB) and COM-Poisson. The models were implemented on software \texttt{R} with package \texttt{TMB}. Besides the full specification, models with simpler structures in the covariance matrix were considered (fixed and common variance, fixed dispersion, $\rho$ set to 0). These models were applied to a dataset from the National Health and Nutrition Examination Survey, where three underdispersed response variables were measured at 1281 subjects. The COM-Poisson model full specified overcome the other two competitors considering three goodness-of-fit indexes. Therefore, the proposed model can deal with multivariate count responses and measures the correlation between them taking into account the effects of the covariates.


title: Scaling Laws and Interpretability of Learning from Repeated Data

abstract: Recent large language models have been trained on vast datasets, but also often on repeated data, either intentionally for the purpose of upweighting higher quality data, or unintentionally because data deduplication is not perfect and the model is exposed to repeated data at the sentence, paragraph, or document level. Some works have reported substantial negative performance effects of this repeated data. In this paper we attempt to study repeated data systematically and to understand its effects mechanistically. To do this, we train a family of models where most of the data is unique but a small fraction of it is repeated many times. We find a strong double descent phenomenon, in which repeated data can lead test loss to increase midway through training. A predictable range of repetition frequency leads to surprisingly severe degradation in performance. For instance, performance of an 800M parameter model can be degraded to that of a 2x smaller model (400M params) by repeating 0.1% of the data 100 times, despite the other 90% of the training tokens remaining unique. We suspect there is a range in the middle where the data can be memorized and doing so consumes a large fraction of the model's capacity, and this may be where the peak of degradation occurs. Finally, we connect these observations to recent mechanistic interpretability work - attempting to reverse engineer the detailed computations performed by the model - by showing that data repetition disproportionately damages copying and internal structures associated with generalization, such as induction heads, providing a possible mechanism for the shift from generalization to memorization. Taken together, these results provide a hypothesis for why repeating a relatively small fraction of data in large language models could lead to disproportionately large harms to performance.


title: Cryptanalysis of Three Quantum Money Schemes

abstract: We investigate the security assumptions behind three public-key quantum money schemes. Aaronson and Christiano proposed a scheme based on hidden subspaces of the vector space $\mathbb{F}_2^n$ in 2012. It was conjectured by Pena et al in 2015 that the hard problem underlying the scheme can be solved in quasi-polynomial time. We confirm this conjecture by giving a polynomial time quantum algorithm for the underlying problem. Our algorithm is based on computing the Zariski tangent space of a random point in the hidden subspace. Zhandry proposed a scheme based on multivariate hash functions in 2017. We give a polynomial time quantum algorithm for cloning a money state with high probability. Our algorithm uses the verification circuit of the scheme to produce a banknote from a given serial number. Kane, Sharif and Silverberg proposed a scheme based on quaternion algebras in 2021. The underlying hard problem in their scheme is cloning a quantum state that represents an eigenvector of a set of Hecke operators. We give a polynomial time quantum reduction from this hard problem to a linear algebra problem. The latter problem is much easier to understand, and we hope that our reduction opens new avenues to future cryptanalyses of this scheme.


title: Social Fragmentation Transitions in Large-Scale Parameter Sweep Simulations of Adaptive Social Networks

abstract: Social fragmentation transition is a transition of social states between many disconnected communities with distinct opinions and a well-connected single network with homogeneous opinions. This is a timely research topic with high relevance to various current societal issues. We had previously studied this problem using numerical simulations of adaptive social network models and found that two individual behavioral traits, homophily and attention to novelty, had the most statistically significant impact on the outcomes of social network evolution. However, our previous study was limited in terms of the range of parameter values examined, and possible interactions between multiple behavioral traits were largely ignored. In this study, we conducted a substantially larger-scale parameter sweep numerical experiment of the same model with expanded parameter ranges by an order of magnitude in each parameter dimension, resulting in a total of 116,640 simulation runs. To capture nontrivial interactions among behavioral parameters, we modeled and visualized the dependence of outcome measures on the model parameters using artificial neural networks. Results show that, while the competition between homophily and attention to novelty is still the primary determinant of social fragmentation, another transition plane emerges when individuals have strong social conformity behavior, which was not previously known. This implies that social fragmentation transition can also occur in the homophily-social conformity trade-off, the two behavioral traits that have very similar microscopic individual-level effects but produce very different macroscopic collective-level outcomes, illustrating the nontrivial macroscopic dynamics of complex collective systems.


title: Aligning Logits Generatively for Principled Black-Box Knowledge Distillation

abstract: Black-Box Knowledge Distillation (B2KD) is a formulated problem for cloud-to-edge model compression with invisible data and models hosted on the server. B2KD faces challenges such as limited Internet exchange and edge-cloud disparity of data distributions. In this paper, we formalize a two-step workflow consisting of deprivatization and distillation, and theoretically provide a new optimization direction from logits to cell boundary different from direct logits alignment. With its guidance, we propose a new method Mapping-Emulation KD (MEKD) that distills a black-box cumbersome model into a lightweight one. Our method does not differentiate between treating soft or hard responses, and consists of: 1) deprivatization: emulating the inverse mapping of the teacher function with a generator, and 2) distillation: aligning low-dimensional logits of the teacher and student models by reducing the distance of high-dimensional image points. For different teacher-student pairs, our method yields inspiring distillation performance on various benchmarks, and outperforms the previous state-of-the-art approaches.


title: LSTM-Based Adaptive Vehicle Position Control for Dynamic Wireless Charging

abstract: Dynamic wireless charging (DWC) is an emerging technology that allows electric vehicles (EVs) to be wirelessly charged while in motion. It is gaining significant momentum as it can potentially address the range limitation issue for EVs. However, due to significant power loss caused by wireless power transfer, improving charging efficiency remains as a major challenge for DWC systems. This paper presents the first LSTM-based vehicle motion control system for DWC designed to maximize charging efficiency. The dynamics of the electromagnetic field generated by the transmitter coils of a DWC system are modeled based on a multi-layer LSTM. The LSTM model is used to make a prediction of the lateral position where the electromagnetic strength is expected to be maximal and to control the EV motion accordingly to optimize charging efficiency. Simulations were conducted to demonstrate that our LSTM-based approach achieves by up to 162.3% higher charging efficiency compared with state-of-the-art vehicle motion control systems focused on keeping an EV in the center of lane.


title: Theoretically Accurate Regularization Technique for Matrix Factorization based Recommender Systems

abstract: Regularization is a popular technique to solve the overfitting problem of machine learning algorithms. Most regularization technique relies on parameter selection of the regularization coefficient. Plug-in method and cross-validation approach are two most common parameter selection approaches for regression methods such as Ridge Regression, Lasso Regression and Kernel Regression. Matrix factorization based recommendation system also has heavy reliance on the regularization technique. Most people select a single scalar value to regularize the user feature vector and item feature vector independently or collectively. In this paper, we prove that such approach of selecting regularization coefficient is invalid, and we provide a theoretically accurate method that outperforms the most widely used approach in both accuracy and fairness metrics.


title: Stability analysis of supermassive primordial stars: a new mass range for general relativistic instability supernovae

abstract: Observed supermassive black holes in the early universe have several proposed formation channels, in part because most of these channels are difficult to probe. One of the more promising channels, the direct collapse of a supermassive star, has several possible probes including the explosion of a helium-core supermassive star triggered by a general relativistic instability. We develop a straightforward method for evaluating the general relativistic radial instability without simplifying assumptions and apply it to population III supermassive stars taken from a post Newtonian stellar evolution code. This method is more accurate than previous determinations and it finds that the instability occurs earlier in the evolutionary life of the star. Using the results of the stability analysis, we perform 1D general relativistic hydrodynamical simulations and we find two general relativistic instability supernovae fueled by alpha capture reactions as well as several lower mass pulsations, analogous to the puslational pair instability process. The mass range for the events (2.6-3.0 $\times 10^4$ ${\rm M}_\odot$) is lower than had been suggested by previous works (5.5 $\times 10^4$ ${\rm M}_\odot$) because the instability occurs earlier in the star's evolution. The explosion may be visible to, among others, JWST, while the discovery of the pulsations opens up additional possibilities for observation.


title: Weak anisotropic Hardy inequality: essential self-adjointness of drift-diffusion operators on domains in $\mathbb{R}^d$, revisited

abstract: We consider the problem of essential self-adjointness of the drift-diffusion operator $H=-\frac{1}{\rho}\nabla\cdot \rho \mathbb D\nabla +V$ on domains $\Omega \subset \mathbb{R}^d$ with $\mathcal{C}^2$-boundary $\partial \Omega$ and for large classes of coefficients $\rho,\; \mathbb{D}$ and $V$. We give criteria showing how the behavior as $x \rightarrow \partial \Omega$ of these coefficients balances to ensure essential self-adjointness of $H$. On the way we prove a weak anisotropic Hardy inequality which is of independent interest.


abstract: Subspace clustering is to find underlying low-dimensional subspaces and cluster the data points correctly. In this paper, we propose a novel multi-view subspace clustering method. Most existing methods suffer from two critical issues. First, they usually adopt a two-stage framework and isolate the processes of affinity learning, multi-view information fusion and clustering. Second, they assume the data lies in a linear subspace which may fail in practice as most real-world datasets may have non-linearity structures. To address the above issues, in this paper we propose a novel Enriched Robust Multi-View Kernel Subspace Clustering framework where the consensus affinity matrix is learned from both multi-view data and spectral clustering. Due to the objective and constraints which is difficult to optimize, we propose an iterative optimization method which is easy to implement and can yield closed solution in each step. Extensive experiments have validated the superiority of our method over state-of-the-art clustering methods.


title: On spectral bands of discrete periodic operators

abstract: We consider discrete periodic operator on $\mathbb Z^d$ with respect to lattices $\Gamma\subset\mathbb Z^d$ of full rank. We describe the class of lattices $\Gamma$ for which the operator may have a spectral gap for arbitrarily small potentials. We also show that, for a large class of lattices, the dimensions of the level sets of spectral band functions at the band edges do not exceed $d-2$.


title: eBIM-GNN : Fast and Scalable energy analysis through BIMs and Graph Neural Networks

abstract: Building Information Modeling has been used to analyze as well as increase the energy efficiency of the buildings. It has shown significant promise in existing buildings by deconstruction and retrofitting. Current cities which were built without the knowledge of energy savings are now demanding better ways to become smart in energy utilization. However, the existing methods of generating BIMs work on building basis. Hence they are slow and expensive when we scale to a larger community or even entire towns or cities. In this paper, we propose a method to creation of prototype buildings that enable us to match and generate statistics very efficiently. Our method suggests better energy efficient prototypes for the existing buildings. The existing buildings are identified and located in the 3D point cloud. We perform experiments on synthetic dataset to demonstrate the working of our approach.


title: Named Entity Linking with Entity Representation by Multiple Embeddings

abstract: We propose a simple and practical method for named entity linking (NEL), based on entity representation by multiple embeddings. To explore this method, and to review its dependency on parameters, we measure its performance on Namesakes, a highly challenging dataset of ambiguously named entities. Our observations suggest that the minimal number of mentions required to create a knowledge base (KB) entity is very important for NEL performance. The number of embeddings is less important and can be kept small, within as few as 10 or less. We show that our representations of KB entities can be adjusted using only KB data, and the adjustment can improve NEL performance. We also compare NEL performance of embeddings obtained from tuning language model on diverse news texts as opposed to tuning on more uniform texts from public datasets XSum, CNN / Daily Mail. We found that tuning on diverse news provides better embeddings.


title: Towards Balanced Three-phase Charging: Phase Optimization in Adaptive Charging Networks

abstract: We study the problem of phase optimization for electric-vehicle (EV) charging. We formulate our problem as a non-convex mixed-integer programming problem whose objective is to minimize the charging loss. Despite the hardness of directly solving this non-convex problem, we solve a relaxation of the original problem by proposing the PXA algorithm where "P", "X", and "A" stand for three variable matrices in the formed phase optimization problems. We show that under certain conditions, the solution is given by the PXA precisely converges to the global optimum. In addition, using the idea of model predictive control (MPC), we design the {PXA-MPC}, which is an online implementation of the PXA. Compared to other empirical phase balancing strategies, the PXA algorithm significantly improves the charging performance by maximizing energy delivery, minimizing charging price, and assisting future energy planning. The efficacy of our algorithm is demonstrated using data collected from a real-world adaptive EV charging network (ACN).


title: A Constraint Dissolving Approach for Nonsmooth Optimization over the Stiefel Manifold

abstract: This paper focus on the minimization of a possibly nonsmooth objective function over the Stiefel manifold. The existing approaches either lack efficiency or can only tackle prox-friendly objective functions. We propose a constraint dissolving function named NCDF and show that it has the same first-order stationary points and local minimizers as the original problem in a neighborhood of the Stiefel manifold. Furthermore, we show that the Clarke subdifferential of NCDF is easy to achieve from the Clarke subdifferential of the objective function. Therefore, various existing approaches for unconstrained nonsmooth optimization can be directly applied to nonsmooth optimization problems over the Stiefel manifold. We propose a framework for developing subgradient-based methods and establish their convergence properties based on prior works. Furthermore, based on our proposed framework, we can develop efficient approaches for optimization over the Stiefel manifold. Preliminary numerical experiments further highlight that the proposed constraint dissolving approach yields efficient and direct implementations of various unconstrained approaches to nonsmooth optimization problems over the Stiefel manifold.


title: Making Video Quality Assessment Models Sensitive to Frame Rate Distortions

abstract: We consider the problem of capturing distortions arising from changes in frame rate as part of Video Quality Assessment (VQA). Variable frame rate (VFR) videos have become much more common, and streamed videos commonly range from 30 frames per second (fps) up to 120 fps. VFR-VQA offers unique challenges in terms of distortion types as well as in making non-uniform comparisons of reference and distorted videos having different frame rates. The majority of current VQA models require compared videos to be of the same frame rate, but are unable to adequately account for frame rate artifacts. The recently proposed Generalized Entropic Difference (GREED) VQA model succeeds at this task, using natural video statistics models of entropic differences of temporal band-pass coefficients, delivering superior performance on predicting video quality changes arising from frame rate distortions. Here we propose a simple fusion framework, whereby temporal features from GREED are combined with existing VQA models, towards improving model sensitivity towards frame rate distortions. We find through extensive experiments that this feature fusion significantly boosts model performance on both HFR/VFR datasets as well as fixed frame rate (FFR) VQA databases. Our results suggest that employing efficient temporal representations can result much more robust and accurate VQA models when frame rate variations can occur.


title: Shocks in radiatively driven time dependent, relativistic jets around black holes

abstract: We study time-dependent relativistic jets under the influence of radiation field of the accretion disk. The accretion disk consists of an inner compact corona and an outer sub-Keplerian disk. The thermodynamics of the fluid is governed by a relativistic equation of state (EoS) for multispecies fluid which enables to study the effect of composition on jet-dynamics. Jets originate from the vicinity of the central black hole where the effect of gravity is significant and traverses large distances where only special relativistic treatment is sufficient. So we have modified the flat metric to include the effect of gravity. In this modified relativistic framework we have developed a new total variation diminishing (TVD) routine along with multispecies EoS for the purpose. We show that the acceleration of jets crucially depends on flow composition. All the results presented are transonic in nature, starting from very low injection velocities, the jets can achieve high Lorentz factors. For sub-Eddington luminosities, lepton dominated jets can be accelerated to Lorentz factors > 50. The change in radiation field due to variation in the accretion disk dynamics will be propagated to the jet in a finite amount of time. Hence any change in radiation field due to a change in disk configuration will affect the lower part of the jet before it affects the outer part. This can drive shock transition in the jet flow. Depending upon the disk oscillation frequency, amplitude and jet parameters these shocks can collide with each other and may trigger shock cascades.


title: A Rademacher type theorem for Hamiltonians $H(x,p)$ and application to absolute minimizers

abstract: We establish a Rademacher type theorem involving Hamiltonians $H(x,p)$ under very weak conditions in both of Euclidean and Carnot-Carath\'eodory spaces. In particular,$H(x,p)$ is assumed to be only measurable in the variable $x$, and to be quasiconvex and lower-semicontinuous in the variable $p$. Without the lower-semicontinuity in the variable $p$, we provide a counter example showing the failure of such a Rademacher type theorem. Moreover, by applying such a Rademacher type theorem we build up an existence result of absolute minimizers for the corresponding $L^\infty$-functional. These improve or extend several known results in the literature.


title: How to Find Actionable Static Analysis Warnings: A Case Study with FindBugs

abstract: Automatically generated static code warnings suffer from a large number of false alarms. Hence, developers only take action on a small percent of those warnings. To better predict which static code warnings should not be ignored, we suggest that analysts need to look deeper into their algorithms to find choices that better improve the particulars of their specific problem. Specifically, we show here that effective predictors of such warnings can be created by methods that locally adjust the decision boundary (between actionable warnings and others). These methods yield a new high water-mark for recognizing actionable static code warnings. For eight open-source Java projects (cassandra, jmeter, commons, lucene-solr, maven, ant, tomcat, derby) we achieve perfect test results on 4/8 datasets and, overall, a median AUC (area under the true negatives, true positives curve) of 92%.


title: A Study on Transformer Configuration and Training Objective

abstract: Transformer-based models have delivered impressive results on many tasks, particularly vision and language tasks. In many model training situations, conventional configurations are typically adopted. For example, we often set the base model with hidden dimensions (i.e. model width) to be 768 and the number of transformer layers (i.e. model depth) to be 12. In this paper, we revisit these conventional configurations. Through theoretical analysis and experimental evaluation, we show that the masked autoencoder is effective in alleviating the over-smoothing issue in deep transformer training. Based on this finding, we propose Bamboo, an idea of using deeper and narrower transformer configurations, for masked autoencoder training. On ImageNet, with such a simple change in configuration, re-designed model achieves 87.1% top-1 accuracy and outperforms SoTA models like MAE and BEiT. On language tasks, re-designed model outperforms BERT with default setting by 1.1 points on average, on GLUE datasets.


title: In-orbit Radiation Damage Characterization of SiPMs in the GRID-02 CubeSat Detector

abstract: Recently, silicon photomultipliers (SiPMs) have been used in several space-borne missions, owing to their solid state, compact size, low operating voltage, and insensitivity to magnetic fields. However, operating SiPMs in space results in radiation damage and degraded performance. In-orbit quantitative studies on these effects are limited. In this study, we present in-orbit SiPM characterization results obtained by the second detector of the Gamma-Ray Integrated Detectors (GRID-02), which was launched on 6 November 2020. An increase in dark current of $\sim$100 $\mu$A/year per SiPM chip (model MicroFJ-60035-TSV) at 28.5 V and 5 $^{\circ}$C was observed. Consequently, the overall noise level (sigma) of the GRID-02 detector increased by $\sim$7.5 keV/year. The estimate of this increase is $\sim$40 $\mu$A/year per SiPM chip at -20 $^{\circ}$C, highlighting the positive effect of using a cooling system.


title: Travel Time, Distance and Costs Optimization for Paratransit Operations using Graph Convolutional Neural Network

abstract: The provision of paratransit services is one option to meet the transportation needs of Vulnerable Road Users (VRUs). Like any other means of transportation, paratransit has obstacles such as high operational costs and longer trip times. As a result, customers are dissatisfied, and paratransit operators have a low approval rating. Researchers have undertaken various studies over the years to better understand the travel behaviors of paratransit customers and how they are operated. According to the findings of these researches, paratransit operators confront the challenge of determining the optimal route for their trips in order to save travel time. Depending on the nature of the challenge, most research used different optimization techniques to solve these routing problems. As a result, the goal of this study is to use Graph Convolutional Neural Networks (GCNs) to assist paratransit operators in researching various operational scenarios in a strategic setting in order to optimize routing, minimize operating costs and minimize their users' travel time. The study was carried out by using a randomized simulated dataset to help determine the decision to make in terms of fleet composition and capacity under different situations. For the various scenarios investigated, the GCN assisted in determining the minimum optimal gap.


title: A Review on the Optimal Fingerprinting Approach in Climate Change Studies

abstract: We provide a review on the "optimal fingerprinting" approach as summarized in Allen and Tett (1999) from a point view of statistical inference in light of the recent criticism of McKitrick (2021). Our review finds that the "optimal fingerprinting" approach would survive much of McKitrick (2021)'s criticism under two conditions: (i) the null simulation of the climate model is independent of the physical observations and (ii) the null simulation provides consistent estimation of the residual covariance matrix of the physical observations, both depend on the conduction and the quality of the climate models. If the latter condition fails, the estimator would be still unbiased and consistent under routine conditions, but losing the "optimal" aspect of the approach. The residual consistency test suggested by Allen and Tett (1999) is valid for checking the agreement between the residual covariances of the null simulation and the physical observations. We further outline the connection between the "optimal fingerprinting" approach and the Feasible Generalized Least Square.


title: Spin Seebeck Effect: Sensitive Probe for Elementary Excitation, Spin Correlation, Transport, Magnetic Order, and Domains in Solids

abstract: The spin Seebeck effect (SSE) refers to the generation of a spin current as a result of a temperature gradient in a magnetic material, which can be detected electrically via the inverse spin Hall effect in a metallic contact. Since the discovery of SSE in 2008, intensive studies on SSE have been conducted to elucidate its origin. SSEs appear in a wide range of magnetic materials including ferro-, ferri-, and antiferro-magnets and also paramagnets with classical or quantum spin fluctuation. SSE voltage reflects fundamental properties of a magnet, such as elementary excitation, static magnetic order, spin correlation, and spin transport. In this article, we review recent progress on SSEs in various systems, with particular emphasis on its emerging role as a probe of these magnetic properties in solids. We also briefly discuss the recently-discovered nuclear SSE.


title: Four sub-Jovian-mass planets detected by high-cadence microlensing surveys

abstract: With the aim of finding short-term planetary signals, we investigated the data collected from the high-cadence microlensing surveys. From this investigation, we found four planetary systems with low planet-to-host mass ratios, including OGLE-2017-BLG-1691L, KMT-2021-BLG-0320L, KMT-2021-BLG-1303L, and KMT-2021-BLG-1554L. Despite the short durations, ranging from a few hours to a couple of days, the planetary signals were clearly detected by the combined data of the lensing surveys. It is found that three of the planetary systems have mass ratios of the order of $10^{-4}$ and the other has a mass ratio slightly greater than $10^{-3}$. The estimated masses indicate that all discovered planets have sub-Jovian masses. The planet masses of KMT-2021-BLG-0320Lb, KMT-2021-BLG-1303Lb, and KMT-2021-BLG-1554Lb correspond to $\sim 0.10$, $\sim 0.38$, and $\sim 0.12$ times of the mass of the Jupiter, and the mass of OGLE-2017-BLG-1691Lb corresponds to that of the Uranus. The estimated mass of the planet host KMT-2021-BLG-1554L, $M_{\rm host}\sim 0.08~M_\odot$, corresponds to the boundary between a star and a brown dwarf. Besides this system, the host stars of the other planetary systems are low-mass stars with masses in the range of $\sim [0.3$--$0.6]~M_\odot$. The discoveries of the planets well demonstrate the capability of the current high-cadence microlensing surveys in detecting low-mass planets.


title: Improving Long Tailed Document-Level Relation Extraction via Easy Relation Augmentation and Contrastive Learning

abstract: Towards real-world information extraction scenario, research of relation extraction is advancing to document-level relation extraction(DocRE). Existing approaches for DocRE aim to extract relation by encoding various information sources in the long context by novel model architectures. However, the inherent long-tailed distribution problem of DocRE is overlooked by prior work. We argue that mitigating the long-tailed distribution problem is crucial for DocRE in the real-world scenario. Motivated by the long-tailed distribution problem, we propose an Easy Relation Augmentation(ERA) method for improving DocRE by enhancing the performance of tailed relations. In addition, we further propose a novel contrastive learning framework based on our ERA, i.e., ERACL, which can further improve the model performance on tailed relations and achieve competitive overall DocRE performance compared to the state-of-arts.


title: Integrable boundaries for the q-Hahn process

abstract: Taking inspiration from the harmonic process with reservoirs introduced by Giardin\`a, Kurchan and the author in arXiv:1904.01048, we propose integrable boundary conditions for its trigonometric deformation which is known as the q-Hahn process. Following the formalism established by Mangazeev and Lu in arXiv:1903.00274 using the stochastic R-matrix, we argue that the proposed boundary conditions can be derived from a transfer matrix constructed in the framework of Sklyanin's extension of the quantum inverse scattering method and consequently preserve the integrable structure of the model. The approach avoids the explicit construction of the K-matrix.

categories: math-ph cond-mat.stat-mech math.MP math.PR nlin.SI


title: Computable Artificial General Intelligence

abstract: Artificial general intelligence (AGI) may herald our extinction, according to AI safety research. Yet claims regarding AGI must rely upon mathematical formalisms -- theoretical agents we may analyse or attempt to build. AIXI appears to be the only such formalism supported by proof that its behaviour is optimal, a consequence of its use of compression as a proxy for intelligence. Unfortunately, AIXI is incomputable and claims regarding its behaviour highly subjective. We argue that this is because AIXI formalises cognition as taking place in isolation from the environment in which goals are pursued (Cartesian dualism). We propose an alternative, supported by proof and experiment, which overcomes these problems. Integrating research from cognitive science with AI, we formalise an enactive model of learning and reasoning to address the problem of subjectivity. This allows us to formulate a different proxy for intelligence, called weakness, which addresses the problem of incomputability. We prove optimal behaviour is attained when weakness is maximised. This proof is supplemented by experimental results comparing weakness and description length (the closest analogue to compression possible without reintroducing subjectivity). Weakness outperforms description length, suggesting it is a better proxy. Furthermore we show that, if cognition is enactive, then minimisation of description length is neither necessary nor sufficient to attain optimal performance, undermining the notion that compression is closely related to intelligence. However, there remain open questions regarding the implementation of scale-able AGI. In the short term, these results may be best utilised to improve the performance of existing systems. For example, our results explain why Deepmind's Apperception Engine is able to generalise effectively, and how to replicate that performance by maximising weakness.


title: Linear stability of the elliptic relative equilibria for the restricted $4$-body problem: the Euler case

abstract: In this paper, we consider the elliptic relative equilibria of the restricted $4$-body problems, where the three primaries form an Euler collinear configuration and the four bodies span $\mathbf{R}^2$. We obtain the symplectic reduction to the general restricted $N$-body problem. By analyzing the relationship between this restricted $4$-body problems and the elliptic Lagrangian solutions, we obtain the linear stability of the restricted $4$-body problem by the $\omega$-Maslov index. Via numerical computations, we also obtain conditions of the stability on the mass parameters for the symmetric cases.


title: Visualizing CoAtNet Predictions for Aiding Melanoma Detection

abstract: Melanoma is considered to be the most aggressive form of skin cancer. Due to the similar shape of malignant and benign cancerous lesions, doctors spend considerably more time when diagnosing these findings. At present, the evaluation of malignancy is performed primarily by invasive histological examination of the suspicious lesion. Developing an accurate classifier for early and efficient detection can minimize and monitor the harmful effects of skin cancer and increase patient survival rates. This paper proposes a multi-class classification task using the CoAtNet architecture, a hybrid model that combines the depthwise convolution matrix operation of traditional convolutional neural networks with the strengths of Transformer models and self-attention mechanics to achieve better generalization and capacity. The proposed multi-class classifier achieves an overall precision of 0.901, recall 0.895, and AP 0.923, indicating high performance compared to other state-of-the-art networks.


title: Chiral gravitational waves from thermalized neutrinos in the early Universe

abstract: We investigate polarized gravitational waves generated by chiral fermions in the early Universe. In particular, we focus on the contribution from left-handed neutrinos in thermal equilibrium with finite temperature and chemical potential in the radiation dominated era. We compute the correlation functions of gravitational fields pertinent to the Stokes parameter $V$ characterizing the circular polarization of gravitational waves in the Minkowski and expanding spacetime backgrounds. In the expanding universe, we find that the thermalized neutrinos induce a non-vanishing $V$ linear to the neutrino degeneracy parameter and wavenumber of gravitational waves in the long wavelength region. While the magnitude of the gravitational waves generated by thermal neutrinos is too small to be detectable by current and planned third generation gravitational wave detectors, their observations by future generation detectors for ultra-high frequency regimes could provide information on the neutrino degeneracy parameter in the early Universe.


title: Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese

abstract: Multilingual language models such as mBERT have seen impressive cross-lingual transfer to a variety of languages, but many languages remain excluded from these models. In this paper, we analyse the effect of pre-training with monolingual data for a low-resource language that is not included in mBERT -- Maltese -- with a range of pre-training set ups. We conduct evaluations with the newly pre-trained models on three morphosyntactic tasks -- dependency parsing, part-of-speech tagging, and named-entity recognition -- and one semantic classification task -- sentiment analysis. We also present a newly created corpus for Maltese, and determine the effect that the pre-training data size and domain have on the downstream performance. Our results show that using a mixture of pre-training domains is often superior to using Wikipedia text only. We also find that a fraction of this corpus is enough to make significant leaps in performance over Wikipedia-trained models. We pre-train and compare two models on the new corpus: a monolingual BERT model trained from scratch (BERTu), and a further pre-trained multilingual BERT (mBERTu). The models achieve state-of-the-art performance on these tasks, despite the new corpus being considerably smaller than typically used corpora for high-resourced languages. On average, BERTu outperforms or performs competitively with mBERTu, and the largest gains are observed for higher-level tasks.


title: Long-time asymptotics for the reverse space-time nonlocal Hirota equation with decaying initial value problem: Without solitons

abstract: In this work, we mainly consider the Cauchy problem for the reverse space-time nonlocal Hirota equation with the initial data rapidly decaying in the solitonless sector. Start from the Lax pair, we first construct the basis Riemann-Hilbert problem for the reverse space-time nonlocal Hirota equation. Furthermore, using the approach of Deift-Zhou nonlinear steepest descent, the explicit long-time asymptotics for the reverse space-time nonlocal Hirota is derived. For the reverse space-time nonlocal Hirota equation, since the symmetries of its scattering matrix are different with the local Hirota equation, the $\vartheta(\lambda_{i})(i=0, 1)$ would like to be imaginary, which results in the $\delta_{\lambda_{i}}^{0}$ contains an increasing $t^{\frac{\pm Im\vartheta(\lambda_{i})}{2}}$, and then the asymptotic behavior for nonlocal Hirota equation becomes differently.


title: Impact of Multiple Fully-Absorbing Receivers in Molecular Communications

abstract: Molecular communication is a promising solution to enable intra-body communications among nanomachines. However, malicious and non-cooperative receivers can degrade the performance, compromising these systems' security. Analyzing the communication and security performance of these systems requires accurate channel models. However, such models are not present in the literature. In this work, we develop an analytical framework to derive the hitting probability of a molecule on a fully absorbing receiver (FAR) in the presence of other FARs, which can be either be cooperative or malicious. We first present an approximate hitting probability expression for the 3-FARs case. A simplified expression is obtained for the case when FARs are symmetrically positioned. Using the derived expressions, we study the impact of malicious receivers on the intended receiver and discuss how to minimize this impact to obtain a secure communication channel. We also study the gain that can be obtained by the cooperation of these FARs. We then present an approach to extend the analysis for a system with N FARs. The derived expressions can be used to analyze and design multiple input/output and secure molecular communication systems.


title: Fair Allocation of Indivisible Chores: Beyond Additive Costs

abstract: We study the maximin share (MMS) fair allocation of $m$ indivisible chores to $n$ agents who have costs for completing the assigned chores. It is known that exact MMS fairness cannot be guaranteed, and so far the best-known approximation for additive cost functions is $\frac{13}{11}$ by Huang and Segal-Halevi [EC, 2023]; however, beyond additivity, very little is known. In this work, we first prove that no algorithm can ensure better than $\min\{n,\frac{\log m}{\log \log m}\}$-approximation if the cost functions are submodular. This result also shows a sharp contrast with the allocation of goods where constant approximations exist as shown by Barman and Krishnamurthy [TEAC, 2020] and Ghodsi et al. [AIJ, 2022]. We then prove that for subadditive costs, there always exists an allocation that is $\min\{n,\lceil\log m\rceil\}$-approximation, and thus the approximation ratio is asymptotically tight. Besides multiplicative approximation, we also consider the ordinal relaxation, 1-out-of-$d$ MMS, which was recently proposed by Hosseini et al. [JAIR and AAMAS, 2022]. Our impossibility result implies that for any $d\ge 2$, a 1-out-of-$d$ MMS allocation may not exist. Due to these hardness results for general subadditive costs, we turn to studying two specific subadditive costs, namely, bin packing and job scheduling. For both settings, we show that constant approximate allocations exist for both multiplicative and ordinal relaxations of MMS.


title: A stochastic Allen-Cahn-Navier-Stokes system with singular potential

abstract: We investigate a stochastic version of the Allen-Cahn-Navier-Stokes system in a smooth two- or three-dimensional domain with random initial data. The system consists of a Navier-Stokes equation coupled with a convective Allen-Cahn equation, with two independent sources of randomness given by general multiplicative-type Wiener noises. In particular, the Allen-Cahn equation is characterized by a singular potential of logarithmic type as prescribed by the classical thermodynamical derivation of the model. The problem is endowed with a no-slip boundary condition for the (volume averaged) velocity field, as well as a homogeneous Neumann condition for the order parameter. We first prove the existence of analytically weak martingale solutions in two and three spatial dimensions. Then, in two dimensions, we also estabilish pathwise uniqueness and the existence of a unique probabilistically-strong solution. Eventually, by exploiting a suitable generalisation of the classical De Rham theorem to stochastic processes, existence and uniqueness of a pressure is also shown.


title: Design-based estimators of distribution function in ranked set sampling with an application

abstract: Empirical distribution functions (EDFs) based on ranked set sampling (RSS) and its modifications have been examined by many authors. In these studies, the proposed estimators have been investigated for infinite population setting. However, developing EDF estimators in finite population setting would be more valuable for areas such as environmental, ecological, agricultural, biological, etc. This paper introduces new EDF estimators based on level-0, level-1 and level-2 sampling designs in RSS. Asymptotic properties of the new EDF estimators have been established. Numerical results have been obtained for the case when ranking is imperfect under different distribution functions. It has been observed that level-2 sampling design provides more efficient EDF estimator than its counterparts of level-0, level-1 and simple random sampling. In real data application, we consider a pointwise estimate of distribution function and estimation of the median of sheep's weights at seven months using RSS based on level-2 sampling design.


title: Accuracy of one-dimensional approximation in neutron star quasi-normal modes

abstract: Since the eigenfrequency of gravitational waves from cold neutron stars becomes a complex number, where the real and imaginary parts respectively correspond to an oscillation frequency and damping rate, one has to somehow solve the eigenvalue problem concerning the eigenvalue in two-dimensional parameter space. To avoid this bother, one sometimes adopts an approximation, where the eigenvalue is in one-dimensional parameter space. In this study, first, we show the accuracy of the zero-damping approximation, which is one of the one-dimensional approximations, for the fundamental and 1st pressure modes. But, this approximation is not applicable to the spacetime mode, because the damping rate of the spacetime mode is generally comparable to the oscillation frequency. Nevertheless, we find the empirical relation for the ratio of the imaginary part to the real part of the eigenfrequency, which is expressed as a function of the steller compactness almost independently of the adopted equations of state for neutron star matter. Adopting this empirical relation, one can express the eigenfrequency in terms of just the real part, i.e., the problem to solve becomes an eigenvalue problem with a one-dimensional eigenvalue. Then, we find that the frequencies are estimated with good accuracy even with such approximations even for the 1st spacetime mode.


title: Robust density estimation with the $\mathbb{L}_{1}$-loss. Applications to the estimation of a density on the line satisfying a shape constraint

abstract: We solve the problem of estimating the distribution of presumed i.i.d. observations for the total variation loss. Our approach is based on density models and is versatile enough to cope with many different ones, including some density models for which the Maximum Likelihood Estimator (MLE for short) does not exist. We mainly illustrate the properties of our estimator on models of densities on the line that satisfy a shape constraint. We show that it possesses some similar optimality properties, with regard to some global rates of convergence, as the MLE does when it exists. It also enjoys some adaptation properties with respect to some specific target densities in the model for which our estimator is proven to converge at parametric rate. More important is the fact that our estimator is robust, not only with respect to model misspecification, but also to contamination, the presence of outliers among the dataset and the equidistribution assumption. This means that the estimator performs almost as well as if the data were i.i.d. with density $p$ in a situation where these data are only independent and most of their marginals are close enough in total variation to a distribution with density $p$. We also show that our estimator converges to the average density of the data, when this density belongs to the model, even when none of the marginal densities belongs to it. Our main result on the risk of the estimator takes the form of an exponential deviation inequality which is non-asymptotic and involves explicit numerical constants. We deduce from it several global rates of convergence, including some bounds for the minimax $\mathbb{L}_{1}$-risks over the sets of concave and log-concave densities. These bounds derive from some specific results on the approximation of densities which are monotone, convex, concave and log-concave. Such results may be of independent interest.


abstract: Noether theorem establishes an interesting connection between symmetries of the action integral and conservation laws of a dynamical system. The aim of the present work is to classify the damped harmonic oscillator problem with respect to Noether symmetries and to construct corresponding conservation laws for all over-damped, under damped and critical damped cases. For each case we obtain maximum five linearly independent group generators which provide related five conserved quantities. Remarkably, after obtaining complete set of invariant quantities we obtain analytical solutions for each case. In the current work, we also introduce a new Lagrangian for the damped harmonic oscillator. Though the form of this new Lagrangian and presented by Bateman are completely different, yet it generates same set of Noether symmetries and conserved quantities. So, this new form of Lagrangian we are presenting here may be seriously interesting for the physicists. Moreover, we also find the Lie algebras of Noether symmetries and point out some interesting aspects of results related to Noether symmetries and first integrals of damped harmonic oscillator which perhaps not reported in the earlier studies.


title: Difference of measured proton and He3 EDMs: a reduced systematics test of T-reversal invariance

abstract: The upper limit on (time reversal symmetry T-violating) permanent hadron electric dipole moments (EDMs) is the PSI neutron EDM value; $d_n = (0.0\pm1.1_{\rm stat}\pm0.2_{\rm sys}\times10^{-26})\,e$\,cm. This paper describes an experiment to be performed at a BNL-proposed CLIP project which is to be capable of producing intense polarized beams of protons, $p$, helions (He${}^3$ nuclei), h, and other isotopes. The EDM prototype ring PTR (proposed at COSY Lab, Juelich) is expected to measure individual particle EDMs (for example ${\rm EDM\_p}$ for the proton) using simultaneous counter-rotating polarized proton beams, with statistical error $\pm10^{-30}$e.cm after one year running time, four orders of magnitude less than the PSI neutron EDM upper limit, and with comparable systematic error. A composite particle, the helion faces T-symmetry constraints more challenging than the proton. Any measurably large value of $$\Delta={\rm EDM}_h-{\rm EDM}_p,$$ the difference of helion and proton EDMs, would represent BSM physics. The plan is to replicate PTR at BNL. The dominant systematic error would be canceled two ways, both made possible by phase-locking "doubly-magic" 38.6\,MeV proton and 39.2\,MeV helion spin tunes. This stabilizes their MDM-induced in-plane precessions, without affecting their EDM-induced out-of-plane precessions. The dominant systematic error would therefore cancel in the meaurement of $\Delta$ in a fixed field configuration. Another systematic error cancellation will come from averaging runs for which both magnetic field and beam circulation directions are reversed. Precise magnetic field reversal is made possible by the reproducible absolute frequency phase-locking over long runs to eliminate the need for (impractically precise) magnetic field measurement. Risk of EDM measurement failure is discussed in a final appendix.


title: Termination of Superradiance from a Binary Companion

abstract: We study the impact of a binary companion on black hole superradiance at orbital frequencies away from the gravitational-collider-physics (GCP) resonance bands. A superradiant state can couple to a strongly absorptive state via the tidal perturbation of the companion, thereby acquiring a suppressed superradiance rate. Below a critical binary separation, this superradiance rate becomes negative, and the boson cloud gets absorbed by the black hole. This critical binary separation leads to tight constraints on GCP. Especially, a companion with mass ratio $q>10^{-3}$ invalidates all GCP fine structure transitions, as well as almost all Bohr transitions except those from the $|\psi_{211}\rangle$ state. Meanwhile, the backreaction on the companion manifests itself as a torque acting on the binary, producing floating/sinking orbits that can be verified via pulsar timing. In addition, the possible termination of cloud growth may help to alleviate the current bounds on the ultralight boson mass from various null detections.


title: PointVector: A Vector Representation In Point Cloud Analysis

abstract: In point cloud analysis, point-based methods have rapidly developed in recent years. These methods have recently focused on concise MLP structures, such as PointNeXt, which have demonstrated competitiveness with Convolutional and Transformer structures. However, standard MLPs are limited in their ability to extract local features effectively. To address this limitation, we propose a Vector-oriented Point Set Abstraction that can aggregate neighboring features through higher-dimensional vectors. To facilitate network optimization, we construct a transformation from scalar to vector using independent angles based on 3D vector rotations. Finally, we develop a PointVector model that follows the structure of PointNeXt. Our experimental results demonstrate that PointVector achieves state-of-the-art performance $\textbf{72.3\% mIOU}$ on the S3DIS Area 5 and $\textbf{78.4\% mIOU}$ on the S3DIS (6-fold cross-validation) with only $\textbf{58\%}$ model parameters of PointNeXt. We hope our work will help the exploration of concise and effective feature representations. The code will be released soon.


title: Fine-Grained Visual Classification using Self Assessment Classifier

abstract: Extracting discriminative features plays a crucial role in the fine-grained visual classification task. Most of the existing methods focus on developing attention or augmentation mechanisms to achieve this goal. However, addressing the ambiguity in the top-k prediction classes is not fully investigated. In this paper, we introduce a Self Assessment Classifier, which simultaneously leverages the representation of the image and top-k prediction classes to reassess the classification results. Our method is inspired by continual learning with coarse-grained and fine-grained classifiers to increase the discrimination of features in the backbone and produce attention maps of informative areas on the image. In practice, our method works as an auxiliary branch and can be easily integrated into different architectures. We show that by effectively addressing the ambiguity in the top-k prediction classes, our method achieves new state-of-the-art results on CUB200-2011, Stanford Dog, and FGVC Aircraft datasets. Furthermore, our method also consistently improves the accuracy of different existing fine-grained classifiers with a unified setup.


title: Scenario-based Multi-product Advertising Copywriting Generation for E-Commerce

abstract: In this paper, we proposed an automatic Scenario-based Multi-product Advertising Copywriting Generation system (SMPACG) for E-Commerce, which has been deployed on a leading Chinese e-commerce platform. The proposed SMPACG consists of two main components: 1) an automatic multi-product combination selection module, which itself is consisted of a topic prediction model, a pattern and attribute-based selection model and an arbitrator model; and 2) an automatic multi-product advertising copywriting generation module, which combines our proposed domain-specific pretrained language model and knowledge-based data enhancement model. The SMPACG is the first system that realizes automatic scenario-based multi-product advertising contents generation, which achieves significant improvements over other state-of-the-art methods. The SMPACG has been not only developed for directly serving for our e-commerce recommendation system, but also used as a real-time writing assistant tool for merchants.


title: Formation of episodic jets and associated flares from black hole accretion systems

abstract: Episodic ejections of blobs (episodic jets) are widely observed in black hole sources and usually associated with flares. In this paper, by performing and analyzing three dimensional general relativity magnetohydrodynamical numerical simulations of accretion flows, we investigate their physical mechanisms. We find that magnetic reconnection occurs in the accretion flow, likely due to the turbulent motion and differential rotation of the accretion flow, resulting in flares and formation of flux ropes. Flux ropes formed inside of 10-15 gravitational radii are found to mainly stay within the accretion flow, while flux ropes formed beyond this radius are ejected outward by magnetic forces and form the episodic jets. These results confirm the basic scenario proposed in Yuan et al.(2009). Moreover, our simulations find that the predicted velocity of the ejected blobs is in good consistency with observations of Sgr A*, M81, and M87. The whole processes are found to occur quasi-periodically, with the period being the orbital time at the radius where the flux rope is formed. The predicted period of flares and ejections is consistent with those found from the light curves or image of Sgr A*, M87, and PKS 1510-089. The possible applications to protostellar accretion systems are discussed.


title: Self-localized topological states in three dimensions

abstract: Three-dimensional (3D) topological materials exhibit much richer phenomena than their lower-dimensional counterparts. Here, we propose self-localized topological states (i.e., topological solitons) in a 3D nonlinear photonic Chern insulator. Despite being in the bulk and self-localized in all 3D, the topological solitons at high-symmetry points K and K' rotate in the same direction, due to the underlying topology. Specifically, under the saturable nonlinearity the solitons are stable over a broad frequency range. Our results highlight how topology and nonlinearity interact with each other and can be extended to other 3D topological systems.


title: Proton Compton Scattering from Linearly Polarized Gamma Rays

abstract: Differential cross sections for Compton scattering from the proton have been measured at scattering angles of $55^\circ$, $90^\circ$, and $125^\circ$ in the laboratory frame using quasimonoenergetic linearly (circularly) polarized photon beams with a weighted mean energy value of 83.4\,MeV (81.3\,MeV). These measurements were performed at the High Intensity Gamma-Ray Source facility at the Triangle Universities Nuclear Laboratory. The results are compared to previous measurements and are interpreted in the chiral effective field theory framework to extract the electromagnetic dipole polarizabilities of the proton, which gives $\alpha_{E1}^p = 13.8\pm1.2_{\rm stat}\pm0.1_{\rm BSR}\pm0.3_{\rm theo}, \beta_{M1}^p = 0.2\mp1.2_{\rm stat}\pm0.1_{\rm BSR}\mp0.3_{\rm theo}$ in units of 10$^{-4}$\, fm$^3$.


title: Direct determination of the excitation energy of quasi-stable isomer $^{180m}$Ta

abstract: $^{180m}$Ta is a naturally abundant quasi-stable nuclide and the longest-lived nuclear isomer known to date. It is of interest for, among others, the search for dark matter, for the development of a gamma laser and for astrophysics. So far, its excitation energy has not been measured directly but has been based on an evaluation of available nuclear reaction data. We have determined the excitation energy of this isomer with high accuracy using the Penning-trap mass spectrometer JYFLTRAP. The determined mass difference between the ground and isomeric states of $^{180}$Ta yields an excitation energy of 76.79(55) keV for $^{180m}$Ta. This is the first direct measurement of the excitation energy and provides a better accuracy than the previous evaluation value, 75.3(14) keV.


title: Deep Learning vs. Gradient Boosting: Benchmarking state-of-the-art machine learning algorithms for credit scoring

abstract: Artificial intelligence (AI) and machine learning (ML) have become vital to remain competitive for financial services companies around the globe. The two models currently competing for the pole position in credit risk management are deep learning (DL) and gradient boosting machines (GBM). This paper benchmarked those two algorithms in the context of credit scoring using three distinct datasets with different features to account for the reality that model choice/power is often dependent on the underlying characteristics of the dataset. The experiment has shown that GBM tends to be more powerful than DL and has also the advantage of speed due to lower computational requirements. This makes GBM the winner and choice for credit scoring. However, it was also shown that the outperformance of GBM is not always guaranteed and ultimately the concrete problem scenario or dataset will determine the final model choice. Overall, based on this study both algorithms can be considered state-of-the-art for binary classification tasks on structured datasets, while GBM should be the go-to solution for most problem scenarios due to easier use, significantly faster training time, and superior accuracy.


title: Knowledge Distillation from A Stronger Teacher

abstract: Unlike existing knowledge distillation methods focus on the baseline settings, where the teacher models and training strategies are not that strong and competing as state-of-the-art approaches, this paper presents a method dubbed DIST to distill better from a stronger teacher. We empirically find that the discrepancy of predictions between the student and a stronger teacher may tend to be fairly severer. As a result, the exact match of predictions in KL divergence would disturb the training and make existing methods perform poorly. In this paper, we show that simply preserving the relations between the predictions of teacher and student would suffice, and propose a correlation-based loss to capture the intrinsic inter-class relations from the teacher explicitly. Besides, considering that different instances have different semantic similarities to each class, we also extend this relational match to the intra-class level. Our method is simple yet practical, and extensive experiments demonstrate that it adapts well to various architectures, model sizes and training strategies, and can achieve state-of-the-art performance consistently on image classification, object detection, and semantic segmentation tasks. Code is available at: https://github.com/hunto/DIST_KD .


title: Integrated Metasurfaces on Silicon Photonics for Emission Shaping and Holographic Projection

abstract: The emerging applications of silicon photonics in free space, such as LiDARs and quantum photonics, urge versatile emission shaping beyond the capabilities of conventional grating couplers. A platform that offers arbitrary shaping of free-space emission while maintaining the CMOS compatibility and monolithic integration is in pressing need. Here we demonstrate a platform that integrates metasurfaces monolithically on silicon photonic integrated circuits. The metasurfaces consist of amorphous silicon nanopillars evanescently coupled to silicon waveguides. We demonstrate experimentally diffraction-limited beam focusing with a Strehl ratio of 0.82, where the focused spot can be switched between two positions. We also realize a meta-hologram experimentally that projects an image above the silicon photonic chip. This platform can add a highly versatile interface to the existing silicon photonic ecosystems for precise delivery of free-space emission.


title: Automated machine learning: AI-driven decision making in business analytics

abstract: The realization that AI-driven decision-making is indispensable in todays fast-paced and ultra-competitive marketplace has raised interest in industrial machine learning (ML) applications significantly. The current demand for analytics experts vastly exceeds the supply. One solution to this problem is to increase the user-friendliness of ML frameworks to make them more accessible for the non-expert. Automated machine learning (AutoML) is an attempt to solve the problem of expertise by providing fully automated off-the-shelf solutions for model choice and hyperparameter tuning. This paper analyzed the potential of AutoML for applications within business analytics, which could help to increase the adoption rate of ML across all industries. The H2O AutoML framework was benchmarked against a manually tuned stacked ML model on three real-world datasets to test its performance, robustness, and reliability. The manually tuned ML model could reach a performance advantage in all three case studies used in the experiment. Nevertheless, the H2O AutoML package proved to be quite potent. It is fast, easy to use, and delivers reliable results, which come close to a professionally tuned ML model. The H2O AutoML framework in its current capacity is a valuable tool to support fast prototyping with the potential to shorten development and deployment cycles. It can also bridge the existing gap between supply and demand for ML experts and is a big step towards fully automated decisions in business analytics.


title: On the Feasibility and Generality of Patch-based Adversarial Attacks on Semantic Segmentation Problems

abstract: Deep neural networks were applied with success in a myriad of applications, but in safety critical use cases adversarial attacks still pose a significant threat. These attacks were demonstrated on various classification and detection tasks and are usually considered general in a sense that arbitrary network outputs can be generated by them. In this paper we will demonstrate through simple case studies both in simulation and in real-life, that patch based attacks can be utilised to alter the output of segmentation networks. Through a few examples and the investigation of network complexity, we will also demonstrate that the number of possible output maps which can be generated via patch-based attacks of a given size is typically smaller than the area they effect or areas which should be attacked in case of practical applications. We will prove that based on these results most patch-based attacks cannot be general in practice, namely they can not generate arbitrary output maps or if they could, they are spatially limited and this limit is significantly smaller than the receptive field of the patches.


title: Productivity Implications of R&D, Innovation, and Capital Accumulation for Incumbents and Entrants: Perspectives from a Catching-up Economy

abstract: We study the productivity implications of R&D, capital accumulation, and innovation output for entrants and incumbents in Estonia. First, in contrast to developed economies, a small percentage of firm engage in formal R&D, but a much larger percentage innovate. Second, while we find no difference in the R&D elasticity of productivity for the entrants and incumbents, the impact of innovation output - many of which are a result of 'doing, using and interacting' (DUI) mode of innovation - is found to be higher for the entrants. Entrants who innovate are 21% to 30% more productive than entrants who do not; the corresponding figures for the incumbents are 10% to 13%. Third, despite the adverse sectoral composition typical of catching-up economies, Estonian incumbents, who are the primary carriers of 'scientific and technologically-based innovative' (STI) activities, are comparable to their counterparts in developed economies in translating STI activities into productivity gains. Fourth, while embodied technological change through capital accumulation is found to be more effective in generating productivity growth than R&D, the effectiveness is higher for firms engaging in R&D. Finally, our results suggest that certain policy recommendations for spurring productivity growth in technologically advanced economies may not be applicable for catching-up economies.


title: Neuroevolutionary Feature Representations for Causal Inference

abstract: Within the field of causal inference, we consider the problem of estimating heterogeneous treatment effects from data. We propose and validate a novel approach for learning feature representations to aid the estimation of the conditional average treatment effect or CATE. Our method focuses on an intermediate layer in a neural network trained to predict the outcome from the features. In contrast to previous approaches that encourage the distribution of representations to be treatment-invariant, we leverage a genetic algorithm that optimizes over representations useful for predicting the outcome to select those less useful for predicting the treatment. This allows us to retain information within the features useful for predicting outcome even if that information may be related to treatment assignment. We validate our method on synthetic examples and illustrate its use on a real life dataset.


title: Microstructure of water sediments on hydrophilic surfaces

abstract: In the modern world, the focus of natural science research thought has shifted mainly to the molecular level, including the study of water. Water is considered as a mixture of interacting H2O molecules and their clusters based on the data of molecular dynamics, neutron and X-ray scattering. In this case, a huge layer of information is lost related to the composition of real water, its microstructure and behavior. In this work, we studied the structure and dynamics of water during its interaction with glass surfaces during drying using optical microscopy. We observed a panoramic picture of a cascade of interrelated phase transitions of distilled water and its microdispersed phase - sodium chloride microcrystals surrounded by a thick layer of hydrate liquid crystal water. Incubation of a glass slide in water for 2 days was accompanied by adhesion of the microdisperse phase to the glass surface. During the free evaporation of distilled water from a Petri dish, erosion of hydration shells, dissolution of NaCl microcrystals, and further recrystallization with the formation of large monolithic crystals and traces of non-drying water were observed. However, there are still questions that do not yet have clear answers. The authors hope to continue research in collaboration with interested colleagues.