title: Towards Radar Emitter Recognition in Changing Environments with Domain Generalization

abstract: Analyzing radar signals from complex Electronic Warfare (EW) environment is a non-trivial task.However, in the real world, the changing EW environment results in inconsistent signal distribution, such as the pulse repetition interval (PRI) mismatch between different detected scenes.In this paper, we propose a novel domain generalization framework to improve the adaptability of signal recognition in changing environments.Specifically, we first design several noise generators to simulate varied scenes. Different from conventional augmentation methods, our introduced generators carefully enhance the diversity of the detected signals and meanwhile maintain the semantic features of the signals. Moreover, we propose a signal scene domain classifier that works in the manner of adversarial learning. The proposed classifier guarantees the signal predictor to generalize to different scenes. Extensive comparative experiments prove the proposed method's superiority.


title: Backdoor Attacks to Pre-trained Unified Foundation Models

abstract: The rise of pre-trained unified foundation models breaks down the barriers between different modalities and tasks, providing comprehensive support to users with unified architectures. However, the backdoor attack on pre-trained models poses a serious threat to their security. Previous research on backdoor attacks has been limited to uni-modal tasks or single tasks across modalities, making it inapplicable to unified foundation models. In this paper, we make proof-of-concept level research on the backdoor attack for pre-trained unified foundation models. Through preliminary experiments on NLP and CV classification tasks, we reveal the vulnerability of these models and suggest future research directions for enhancing the attack approach.


title: Analysis of Many-body Localization Landscapes and Fock Space Morphology via Persistent Homology

abstract: We analyze functionals that characterize the distribution of eigenstates in Fock space through a tool derived from algebraic topology: persistent homology. Drawing on recent generalizations of the localization landscape applicable to mid-spectrum eigenstates, we introduce several novel persistent homology observables in the context of many-body localization that exhibit transitional behavior near the critical point. We demonstrate that the persistent homology approach to localization landscapes and, in general, functionals on the Fock space lattice offer insights into the structure of eigenstates unobtainable by traditional means.


title: Towards a quasiphase transition in the single-file chain of water molecules: Simple lattice model

abstract: Recently, X.Ma et al. [Phys. Rev. Lett. 118, 027402 (2017)] have suggested that water molecules encapsulated in (6,5) single-wall carbon nanotube experience a temperature-induced quasiphase transition around 150 K interpreted as changes in the water dipoles orientation. We discuss further this temperature-driven quasiphase transition performing quantum chemical calculations and molecular dynamics simulations and, most importantly, suggesting a simple lattice model to reproduce the properties of the one-dimensionally confined finite arrays of water molecules. The lattice model takes into account not only the short-range and long-range interactions but also the rotations in a narrow tube and the both ingredients provide an explanation for a temperature-driven orientational ordering of the water molecules, which persists within a relatively wide temperature range.

categories: cond-mat.stat-mech cond-mat.mes-hall cond-mat.soft physics.chem-ph


title: Autocodificadores Variacionales (VAE) Fundamentos Te\'oricos y Aplicaciones

abstract: VAEs are probabilistic graphical models based on neural networks that allow the coding of input data in a latent space formed by simpler probability distributions and the reconstruction, based on such latent variables, of the source data. After training, the reconstruction network, called decoder, is capable of generating new elements belonging to a close distribution, ideally equal to the original one. This article has been written in Spanish to facilitate the arrival of this scientific knowledge to the Spanish-speaking community.


title: Quantum dynamical speedup for correlated initial states

abstract: The maximal evolution speed of any quantum system can be expressed by the quantum speed limit time. In this paper, we consider a model in which the system has a correlation with the environment. The influence of the initial correlation between the system and environment on the quantum speed limit is investigated. It is shown that the appearance of non-Markovianity effects causes the speedup of quantum evolution. Moreover, we demonstrate the dependence of quantum dynamical speedup on the quantum coherence of the correlated initial state.


title: Hyneter: Hybrid Network Transformer for Object Detection

abstract: In this paper, we point out that the essential differences between CNN-based and Transformer-based detectors, which cause the worse performance of small objects in Transformer-based methods, are the gap between local information and global dependencies in feature extraction and propagation. To address these differences, we propose a new vision Transformer, called Hybrid Network Transformer (Hyneter), after pre-experiments that indicate the gap causes CNN-based and Transformer-based methods to increase size-different objects result unevenly. Different from the divide and conquer strategy in previous methods, Hyneters consist of Hybrid Network Backbone (HNB) and Dual Switching module (DS), which integrate local information and global dependencies, and transfer them simultaneously. Based on the balance strategy, HNB extends the range of local information by embedding convolution layers into Transformer blocks, and DS adjusts excessive reliance on global dependencies outside the patch.


title: Gyro-Groups, Gyro-splittings and Co-homology

abstract: In this paper, we study gyro-groups associated to groups, group extensions admitting gyro-sections, and corresponding co-homologies. We also describe the obstructions in terms of co-homomology. The notion of gyro-Schur Multiplier and that of gyro-Milnor $K_{2}$ group are introduced.


title: Switching-Algebraic Calculation of Banzhaf Voting Indices

abstract: This paper employs switching-algebraic techniques for the calculation of a fundamental index of voting powers, namely, the total Banzhaf power. This calculation involves two distinct operations: (a) Boolean differencing or differentiation, and (b) computation of the weight (the number of true vectors or minterms) of a switching function. Both operations can be considerably simplified and facilitated if the pertinent switching function is symmetric or it is expressed in a disjoint sum-of-products form. We provide a tutorial exposition on how to implement these two operations, with a stress on situations in which partial symmetry is observed among certain subsets of a set of arguments. We introduce novel Boolean-based symmetry-aware techniques for computing the Banzhaf index by way of two prominent voting systems. These are scalar systems involving six variables and nine variables, respectively. The paper is a part of our ongoing effort for transforming the methodologies and concepts of voting systems to the switching-algebraic domain, and subsequently utilizing switching-algebraic tools in the calculation of pertinent quantities in voting theory.


title: Natural Language-conditioned Reinforcement Learning with Inside-out Task Language Development and Translation

abstract: Natural Language-conditioned reinforcement learning (RL) enables the agents to follow human instructions. Previous approaches generally implemented language-conditioned RL by providing human instructions in natural language (NL) and training a following policy. In this outside-in approach, the policy needs to comprehend the NL and manage the task simultaneously. However, the unbounded NL examples often bring much extra complexity for solving concrete RL tasks, which can distract policy learning from completing the task. To ease the learning burden of the policy, we investigate an inside-out scheme for natural language-conditioned RL by developing a task language (TL) that is task-related and unique. The TL is used in RL to achieve highly efficient and effective policy training. Besides, a translator is trained to translate NL into TL. We implement this scheme as TALAR (TAsk Language with predicAte Representation) that learns multiple predicates to model object relationships as the TL. Experiments indicate that TALAR not only better comprehends NL instructions but also leads to a better instruction-following policy that improves 13.4% success rate and adapts to unseen expressions of NL instruction. The TL can also be an effective task abstraction, naturally compatible with hierarchical RL.


title: Calibrating the Rigged Lottery: Making All Tickets Reliable

abstract: Although sparse training has been successfully used in various resource-limited deep learning tasks to save memory, accelerate training, and reduce inference time, the reliability of the produced sparse models remains unexplored. Previous research has shown that deep neural networks tend to be over-confident, and we find that sparse training exacerbates this problem. Therefore, calibrating the sparse models is crucial for reliable prediction and decision-making. In this paper, we propose a new sparse training method to produce sparse models with improved confidence calibration. In contrast to previous research that uses only one mask to control the sparse topology, our method utilizes two masks, including a deterministic mask and a random mask. The former efficiently searches and activates important weights by exploiting the magnitude of weights and gradients. While the latter brings better exploration and finds more appropriate weight values by random updates. Theoretically, we prove our method can be viewed as a hierarchical variational approximation of a probabilistic deep Gaussian process. Extensive experiments on multiple datasets, model architectures, and sparsities show that our method reduces ECE values by up to 47.8\% and simultaneously maintains or even improves accuracy with only a slight increase in computation and storage burden.


title: Testing Super-Eddington Accretion onto a Supermassive Black Hole: Reverberation Mapping of PG 1119+120

abstract: We measure the black hole mass and investigate the accretion flow around the local ($z=0.0502$) quasar PG 1119+120. Spectroscopic monitoring with Calar Alto provides H$\beta$ lags and linewidths from which we estimate a black hole mass of $\log \left(M_{\bullet}/\mathrm{M}_{\odot} \right) = 7.0$, uncertain by $\sim0.4$ dex. High cadence photometric monitoring over two years with the Las Cumbres Observatory provides lightcurves in 7 optical bands suitable for intensive continuum reverberation mapping. We identify variability on two timescales. Slower variations on a 100-day timescale exhibit excess flux and increased lag in the $u'$ band and are thus attributable to diffuse bound-free continuum emission from the broad line region. Faster variations that we attribute to accretion disc reprocessing lack a $u'$-band excess and have flux and delay spectra consistent with either $\tau \propto \lambda^{4/3}$, as expected for a temperature structure of $T(R) \propto R^{-3/4}$ for a thin accretion disc, or $\tau \propto \lambda^{2}$ expected for a slim disc. Decomposing the flux into variable (disc) and constant (host galaxy) components, we find the disc SED to be flatter than expected with $f_{\nu} \sim \rm{const}$. Modelling the SED predicts an Eddington ratio of $\lambda_{\rm Edd} > 1$, where the flat spectrum can be reproduced by a slim disc with little dust extinction or a thin disc which requires more dust extinction. While this accretion is super-Eddington, the geometry is still unclear, however a slim disc is expected due to the high radiation pressure at these accretion rates, and is entirely consistent with our observations.


title: Phase-space analysis of an Einstein-Gauss-Bonnet scalar field cosmology

abstract: We perform a detailed study of the phase-space of the field equations of an Einstein-Gauss-Bonnet scalar field cosmology for a spatially flat Friedmann--Lema\^{\i}tre--Robertson--Walker spacetime. For the scalar field potential, we consider the exponential function. In contrast, for the coupling function of the scalar field with the Gauss-Bonnet term, we assume two cases, the exponential function and the power-law function. We write the field equations in dimensionless variables and study the equilibrium points using Poincare variables. For the exponential coupling function, the asymptotic solutions describe de Sitter universes or spacetimes where the Gauss-Bonnet term dominates. We recovered previous results but found new asymptotic solutions not previously studied. For the power-law coupling function, equilibrium points which describe the scaling solution appear. Finally, the power-law coupling provides a rich cosmological phenomenology.


title: Euclid preparation. XXX. Performance assessment of the NISP Red-Grism through spectroscopic simulations for the Wide and Deep surveys

abstract: This work focuses on the pilot run of a simulation campaign aimed at investigating the spectroscopic capabilities of the Euclid Near-Infrared Spectrometer and Photometer (NISP), in terms of continuum and emission line detection in the context of galaxy evolutionary studies. To this purpose we constructed, emulated, and analysed the spectra of 4992 star-forming galaxies at $0.3 \leq z \leq 2.5$ using the NISP pixel-level simulator. We built the spectral library starting from public multi-wavelength galaxy catalogues, with value-added information on spectral energy distribution (SED) fitting results, and from Bruzual and Charlot (2003) stellar population templates. Rest-frame optical and near-IR nebular emission lines were included using empirical and theoretical relations. We inferred the 3.5$\sigma$ NISP red grism spectroscopic detection limit of the continuum measured in the $H$ band for star-forming galaxies with a median disk half-light radius of \ang{;;0.4} at magnitude $H= 19.5\pm0.2\,$AB$\,$mag for the Euclid Wide Survey and at $H = 20.8\pm0.6\,$AB$\,$mag for the Euclid Deep Survey. We found a very good agreement with the red grism emission line detection limit requirement for the Wide and Deep surveys. We characterised the effect of the galaxy shape on the detection capability of the red grism and highlighted the degradation of the quality of the extracted spectra as the disk size increases. In particular, we found that the extracted emission line signal to noise ratio (SNR) drops by $\sim\,$45$\%$ when the disk size ranges from \ang{;;0.25} to \ang{;;1}. These trends lead to a correlation between the emission line SNR and the stellar mass of the galaxy and we demonstrate the effect in a stacking analysis unveiling emission lines otherwise too faint to detect.


title: Maximal Violation of Kirchhoff's Law in Planar Heterostructures

abstract: Violating Kirchhoff's law has so far required nonreciprocal materials patterned in microstructures. In these configurations, the excitation of a guided or polaritonic mode that lies outside the light cone, often via gratings, was a requirement. Here, we describe how nonreciprocity manifests itself in pattern-free heterostructures. We demonstrate that a resonant mode in a dielectric spacer separating a nonreciprocal film from a back-reflector suffices to maximally violate Kirchhoff's law, and identify the minimal dielectric requirements for such functionality, which are satisfied by currently available materials.


title: Multiscale constitutive framework of 1D blood flow modeling: Asymptotic limits and numerical methods

abstract: In this paper, a multiscale constitutive framework for one-dimensional blood flow modeling is presented and discussed. By analyzing the asymptotic limits of the proposed model, it is shown that different types of blood propagation phenomena in arteries and veins can be described through an appropriate choice of scaling parameters, which are related to distinct characterizations of the fluid-structure interaction mechanism (whether elastic or viscoelastic) that exist between vessel walls and blood flow. In these asymptotic limits, well-known blood flow models from the literature are recovered. Additionally, by analyzing the perturbation of the local elastic equilibrium of the system, a new viscoelastic blood flow model is derived. The proposed approach is highly flexible and suitable for studying the human cardiovascular system, which is composed of vessels with high morphological and mechanical variability. The resulting multiscale hyperbolic model of blood flow is solved using an asymptotic-preserving Implicit-Explicit Runge-Kutta Finite Volume method, which ensures the consistency of the numerical scheme with the different asymptotic limits of the mathematical model without affecting the choice of the time step by restrictions related to the smallness of the scaling parameters. Several numerical tests confirm the validity of the proposed methodology, including a case study investigating the hemodynamics of a thoracic aorta in the presence of a stent.


title: Aritmethic lattices of $\SO(1,n)$ and units of group rings

abstract: We establish that standard arithmetic subgroups of a special orthogonal group ${\rm SO}(1,n)$ are conjugacy separable. As an application we deduce this property for unit groups of certain integer group rings. We also prove that finite quotients of group of units of any of these group rings determines the original group ring.


title: Why is parameter averaging beneficial in SGD? An objective smoothing perspective

abstract: It is often observed that stochastic gradient descent (SGD) and its variants implicitly select a solution with good generalization performance; such implicit bias is often characterized in terms of the sharpness of the minima. Kleinberg et al. (2018) connected this bias with the smoothing effect of SGD which eliminates sharp local minima by the convolution using the stochastic gradient noise. We follow this line of research and study the commonly-used averaged SGD algorithm, which has been empirically observed in Izmailov et al. (2018) to prefer a flat minimum and therefore achieves better generalization. We prove that in certain problem settings, averaged SGD can efficiently optimize the smoothed objective which avoids sharp local minima. In experiments, we verify our theory and show that parameter averaging with an appropriate step size indeed leads to significant improvement in the performance of SGD.


title: Cognitive Architecture for Decision-Making Based on Brain Principles Programming (in Russian)

abstract: We describe a cognitive architecture intended to solve a wide range of problems based on the five identified principles of brain activity, with their implementation in three subsystems: logical-probabilistic inference, probabilistic formal concepts, and functional systems theory. Building an architecture involves the implementation of a task-driven approach that allows defining the target functions of applied applications as tasks formulated in terms of the operating environment corresponding to the task, expressed in the applied ontology. We provide a basic ontology for a number of practical applications as well as for the subject domain ontologies based upon it, describe the proposed architecture, and give possible examples of the execution of these applications in this architecture.


title: Modelos Generativos basados en Mecanismos de Difusi\'on

abstract: Diffusion-based generative models are a design framework that allows generating new images from processes analogous to those found in non-equilibrium thermodynamics. These models model the reversal of a physical diffusion process in which two miscible liquids of different colors progressively mix until they form a homogeneous mixture. Diffusion models can be applied to signals of a different nature, such as audio and image signals. In the image case, a progressive pixel corruption process is carried out by applying random noise, and a neural network is trained to revert each one of the corruption steps. For the reconstruction process to be reversible, it is necessary to carry out the corruption very progressively. If the training of the neural network is successful, it will be possible to generate an image from random noise by chaining a number of steps similar to those used for image deconstruction at training time. In this article we present the theoretical foundations on which this method is based as well as some of its applications. This article is in Spanish to facilitate the arrival of this scientific knowledge to the Spanish-speaking community.


title: Comparing zero-parameter theories for the WCA and harmonic-repulsive melting lines

abstract: The melting line of the Weeks-Chandler-Andersen (WCA) system was recently determined accurately and compared to the predictions of four analytical hard-sphere approximations [Attia et al., J. Chem. Phys. 157, 034502 (2022)]. Here, we study an alternative zero-parameter prediction based on the isomorph theory, the input of which relate to properties at a single reference state point on the melting line. The two central assumptions made are that the harmonic-repulsive potential approximates the WCA potential and that pair collisions are uncorrelated. The new approach gives excellent predictions at high temperatures, while the hard-sphere-theory based predictions are better at lower temperatures. Supplementing the WCA investigation, the face-centered-crystal to fluid coexistence line is determined for a system of harmonic-repulsive particles and compared to the zero-parameter theories. The results indicate that the excellent isomorph-theory predictions for the WCA potential at higher temperatures may be partly due to a cancellation of errors between the two above-mentioned assumptions.


title: Multiphase condensation in cluster halos: interplay of cooling, buoyancy and mixing

abstract: Gas in the central regions of cool-core clusters and other massive halos has a short cooling time ($\lesssim1~\mathrm{Gyr}$). Theoretical models predict that this gas is susceptible to multiphase condensation, in which cold gas is expected to condense out of the hot phase if the ratio of the thermal instability growth time scale ($t_{\mathrm{ti}}$) to the free-fall time ($t_{\mathrm{ff}}$) is $t_{\mathrm{ti}}/t_{\mathrm{ff}}\lesssim10$. The turbulent mixing time $t_{\mathrm{mix}}$ is another important time scale: if $t_{\mathrm{mix}}$ is short enough, the fluctuations are mixed before they can cool. In this study, we perform high-resolution ($512^2\times768$--$1024^2\times1536$ resolution elements) hydrodynamic simulations of turbulence in a stratified medium, including radiative cooling of the gas. We explore the parameter space of $t_{\mathrm{ti}}/t_{\mathrm{ff}}$ and $t_{\mathrm{ti}}/t_{\mathrm{mix}}$ relevant to galaxy and cluster halos. We also study the effect of the steepness of the entropy profile, the strength of turbulent forcing and the nature of turbulent forcing (natural mixture vs. compressive modes) on multiphase gas condensation. We find that larger values of $t_{\mathrm{ti}}/t_{\mathrm{ff}}$ or $t_{\mathrm{ti}}/t_{\mathrm{mix}}$ generally imply stability against multiphase gas condensation, whereas larger density fluctuations (e.g., due to compressible turbulence) promote multiphase gas condensation. We propose a new criterion $\min(t_{\mathrm{ti}}/\min(t_{\mathrm{mix}},t_\mathrm{ff}))\lesssim c_2\times\exp(c_1\sigma_s)$ for when the halo becomes multiphase, where $\sigma_s$ denotes the amplitude of logarithmic density fluctuations and $c_1\simeq6$, $c_2\simeq1.8$ from an empirical fit to our results.


title: Speaker and Language Change Detection using Wav2vec2 and Whisper

abstract: We investigate recent transformer networks pre-trained for automatic speech recognition for their ability to detect speaker and language changes in speech. We do this by simply adding speaker (change) or language targets to the labels. For Wav2vec2 pre-trained networks, we also investigate if the representation for the speaker change symbol can be conditioned to capture speaker identity characteristics. Using a number of constructed data sets we show that these capabilities are definitely there, with speaker recognition equal error rates of the order of 10% and language detection error rates of a few percent. We will publish the code for reproducibility.


title: Co-trading networks for modeling dynamic interdependency structures and estimating high-dimensional covariances in US equity markets

abstract: The time proximity of trades across stocks reveals interesting topological structures of the equity market in the United States. In this article, we investigate how such concurrent cross-stock trading behaviors, which we denote as co-trading, shape the market structures and affect stock price co-movements. By leveraging a co-trading-based pairwise similarity measure, we propose a novel method to construct dynamic networks of stocks. Our empirical studies employ high-frequency limit order book data from 2017-01-03 to 2019-12-09. By applying spectral clustering on co-trading networks, we uncover economically meaningful clusters of stocks. Beyond the static Global Industry Classification Standard (GICS) sectors, our data-driven clusters capture the time evolution of the dependency among stocks. Furthermore, we demonstrate statistically significant positive relations between low-latency co-trading and return covariance. With the aid of co-trading networks, we develop a robust estimator for high-dimensional covariance matrix, which yields superior economic value on portfolio allocation. The mean-variance portfolios based on our covariance estimates achieve both lower volatility and higher Sharpe ratios than standard benchmarks.


title: Polynomial representation for multipartite entanglement of resonating valence bond ladders

abstract: A resonating valence bond (RVB) state of a lattice of quantum systems is a potential resource for quantum computing and communicating devices. It is a superposition of singlet, i.e., dimer, coverings - often restricted to nearest-neighbour ones - of the lattice. We develop a polynomial representation of multipartite quantum states to prove that RVB states on ladder lattices possess genuine multipartite entanglement. The multipartite entanglement of doped RVB states and RVB states that are superposed with varying weights for singlet coverings of ladder lattices can both be detected by using this technique.


title: Time series analysis of bright TESS RRc stars: Additional modes, phase variations and more

abstract: Using two years of data from the TESS space telescope, we have investigated the time series of 633 overtone pulsating field RR Lyrae (RRc) stars. The majority of stars (82.8 per cent) contain additional frequencies beyond the main pulsation. In addition to the frequencies previously explained by the $\ell = 8$ and $\ell = 9$ non-radial modes, we have identified a group of stars where the additional frequencies may belong to the $\ell = 10$ non-radial modes. We found that stars with no additional frequencies are more common among stars with shorter periods, while stars with longer periods almost always show additional frequencies. The incidence rate and this period distribution both agree well with the predictions of recent theoretical models. The amplitude and phase of additional frequencies are varying in time. The frequencies of different non-radial modes appearing in a given star seem to vary on different timescales. We have determined a 10.4 per cent incidence rate for the Blazhko effect. For several stars we have detected continuous annual-scale phase change without significant amplitude variation. This type of variation offers a plausible explanation for the `phase jump' phenomenon reported in many RRc stars. The main pulsation frequency could show quasi-periodic phase and amplitude fluctuations. This fluctuation is clearly related to additional frequencies present in the star: stars with two non-radial modes show the strongest fluctuations, while stars with no such modes show no fluctuations at all. The summation of the phase fluctuation over time may explain the O-C variations that have long been known for many non-Blazhko RRc stars.


title: Anisotropic optical response of arthopods's cuticle

abstract: The structure of the cuticle of arthropods consists of layers of microfilamentary chitin particles. The layers are stacked one on top of the other realizing a helical (Bouligand helix) pattern. This structure generates optical phenomena such as structural colors and birefringence that produce a metalic or iridescent appearance, polarization upon reflection and optical activity. We model the anisotropic optical responses of the cuticle of arthropods using the Photonic package to obtain the macroscopic dielectric tensor of a constitutive layer in the Bouligand helix. We find that its anisotropy depends on the shape of the chitin particles, their reticular arrangement and their filling fractions. As a main result, we obtained a cuticle model with tunable reflectance band gaps that are very sensitive to geometrical parameters such as the angle $\theta$ that controls the helix pitch. We can explain the structural colors in terms of the reflectance band gap induced by the modulation of the anisotropy mediated by $\theta$, instead of following the usual approach that consider multiple arrangement of layers pairs with different thickness and optical properties.


title: Renormalization on the DFR Quantum Spacetime

abstract: An approach to renormalization of scalar fields on the Doplicher-Fredenhagen-Roberts (DFR) quantum spacetime is presented. The effective non-local theory obtained through the use of states of optimal localization for the quantum spacetime is reformulated in the language of (perturbative) Algebraic Quantum Field Theory. The structure of the singularities associated to the non-local kernel that codifies the effects of noncommutativity is analyzed using the tools of microlocal analysis.


title: A note on some generalized curvature tensor

abstract: For any semi-Riemannian manifold (M,g) we define some generalized curvature tensor as a linear combination of Kulkarni-Nomizu products formed by the metric tensor, the Ricci tensor and its square of given manifold. That tensor is closely related to quasi-Einstein spaces, Roter spaces and some Roter type spaces.


title: Generalized Besov-type and Triebel-Lizorkin-type spaces

abstract: Let $0<p<\infty$, $0<q\leq\infty$, and $s\in\mathbb{R}$. We introduce a new type of generalized Besov-type spaces $B_{p,q}^{s,\varphi}(\mathbb{R}^d)$ and generalized Triebel-Lizorkin-type spaces $F_{p,q}^{s,\varphi}(\mathbb{R}^d)$, where $\varphi$ belongs to the class $\mathcal{G}_p$, that is, $\varphi:(0,\infty) \rightarrow (0,\infty)$ is nondecreasing and $t^{-d/p}\varphi(t)$ is nonincreasing in $t>0$. We establish several properties, including some embedding properties, of these spaces. We also obtain the atomic decomposition of the spaces $B_{p,q}^{s,\varphi}(\mathbb{R}^d)$ and $F_{p,q}^{s,\varphi}(\mathbb{R}^d)$.


title: Vulnerability analysis of captcha using Deep learning

abstract: Several websites improve their security and avoid dangerous Internet attacks by implementing CAPTCHAs (Completely Automated Public Turing test to tell Computers and Humans Apart), a type of verification to identify whether the end-user is human or a robot. The most prevalent type of CAPTCHA is text-based, designed to be easily recognized by humans while being unsolvable towards machines or robots. However, as deep learning technology progresses, development of convolutional neural network (CNN) models that predict text-based CAPTCHAs becomes easier. The purpose of this research is to investigate the flaws and vulnerabilities in the CAPTCHA generating systems in order to design more resilient CAPTCHAs. To achieve this, we created CapNet, a Convolutional Neural Network. The proposed platform can evaluate both numerical and alphanumerical CAPTCHAs


title: Mean field models of flux transport dynamo and meridional circulation in the Sun and stars

abstract: The most widely accepted model of the solar cycle is the flux transport dynamo model. This model evolved out of the traditional $\alpha \Omega$ dynamo model which was first developed at a time when the existence of the Sun's meridional circulation was not known. In these models, the toroidal magnetic field (which gives rise to sunspots) is generated by the stretching of the poloidal field by solar differential rotation. The primary source of the poloidal field in the flux transport models is attributed to the Babcock--Leighton mechanism, in contrast to the mean-field $\alpha$-effect used in earlier models. With the realization that the Sun has a meridional circulation, which is poleward at the surface and is expected to be equatorward at the bottom of the convection zone, its importance for transporting the magnetic fields in the dynamo process was recognized. Much of our understanding about the physics of both the meridional circulation and the flux transport dynamo has come from the mean field theory obtained by averaging the equations of MHD over turbulent fluctuations. The mean field theory of meridional circulation makes clear how it arises out of an interplay between the centrifugal and thermal wind terms. We provide a broad review of mean field theories for solar magnetic fields and flows, the flux transport dynamo modeling paradigm and highlight some of their applications to solar and stellar magnetic cycles. We also discuss how the dynamo-generated magnetic field acts on the meridional circulation of the Sun and how the fluctuations in the meridional circulation, in turn, affect the solar dynamo. We conclude with some remarks on how the synergy of mean field theories, flux transport dynamo models, and direct numerical simulations can inspire the future of this field.


title: Diagnostic Quality Assessment of Fundus Photographs: Hierarchical Deep Learning with Clinically Significant Explanations

abstract: Fundus photography (FP) remains the primary imaging modality in screening various retinal diseases including age-related macular degeneration, diabetic retinopathy and glaucoma. FP allows the clinician to examine the ocular fundus structures such as the macula, the optic disc (OD) and retinal vessels, whose visibility and clarity in an FP image remain central to ensuring diagnostic accuracy, and hence determine the diagnostic quality (DQ). Images with low DQ, resulting from eye movement, improper illumination and other possible causes, should obviously be recaptured. However, the technician, often unfamiliar with DQ criteria, initiates recapture only based on expert feedback. The process potentially engages the imaging device multiple times for single subject, and wastes the time and effort of the ophthalmologist, the technician and the subject. The burden could be prohibitive in case of teleophthalmology, where obtaining feedback from the remote expert entails additional communication cost and delay. Accordingly, a strong need for automated diagnostic quality assessment (DQA) has been felt, where an image is immediately assigned a DQ category. In response, motivated by the notional continuum of DQ, we propose a hierarchical deep learning (DL) architecture to distinguish between good, usable and unusable categories. On the public EyeQ dataset, we achieve an accuracy of 89.44%, improving upon existing methods. In addition, using gradient based class activation map (Grad-CAM), we generate a visual explanation which agrees with the expert intuition. Future FP cameras equipped with the proposed DQA algorithm will potentially improve the efficacy of the teleophthalmology as well as the traditional system.


title: Extended Excess Hazard Models for Spatially Dependent Survival Data

abstract: Relative survival represents the preferred framework for the analysis of population cancer survival data. The aim is to model the survival probability associated to cancer in the absence of information about the cause of death. Recent data linkage developments have allowed for incorporating the place of residence into the population cancer data bases; however, modeling this spatial information has received little attention in the relative survival setting. We propose a flexible parametric class of spatial excess hazard models (along with inference tools), named "Relative Survival Spatial General Hazard" (RS-SGH), that allows for the inclusion of fixed and spatial effects in both time-level and hazard-level components. We illustrate the performance of the proposed model using an extensive simulation study, and provide guidelines about the interplay of sample size, censoring, and model misspecification. We present a case study using real data from colon cancer patients in England. This case study illustrates how a spatial model can be used to identify geographical areas with low cancer survival, as well as how to summarize such a model through marginal survival quantities and spatial effects.


title: On perfect subdivision tilings

abstract: For a given graph $H$, we say that a graph $G$ has a perfect $H$-subdivision tiling if $G$ contains a collection of vertex-disjoint subdivisions of $H$ covering all vertices of $G.$ Let $\delta_{sub}(n, H)$ be the smallest integer $k$ such that any $n$-vertex graph $G$ with minimum degree at least $k$ has a perfect $H$-subdivision tiling. For every graph $H$, we asymptotically determined the value of $\delta_{sub}(n, H)$. More precisely, for every graph $H$ with at least one edge, there is a constant $1 < \xi^*(H)\leq 2$ such that $\delta_{sub}(n, H) = \left(1 - \frac{1}{\xi^*(H)} + o(1) \right)n$ if $H$ has a bipartite subdivision with two parts having different parities. Otherwise, the threshold depends on the parity of $n.$


title: Deep Neural Networks based Meta-Learning for Network Intrusion Detection

abstract: The digitization of different components of industry and inter-connectivity among indigenous networks have increased the risk of network attacks. Designing an intrusion detection system to ensure security of the industrial ecosystem is difficult as network traffic encompasses various attack types, including new and evolving ones with minor changes. The data used to construct a predictive model for computer networks has a skewed class distribution and limited representation of attack types, which differ from real network traffic. These limitations result in dataset shift, negatively impacting the machine learning models' predictive abilities and reducing the detection rate against novel attacks. To address the challenges, we propose a novel deep neural network based Meta-Learning framework; INformation FUsion and Stacking Ensemble (INFUSE) for network intrusion detection. First, a hybrid feature space is created by integrating decision and feature spaces. Five different classifiers are utilized to generate a pool of decision spaces. The feature space is then enriched through a deep sparse autoencoder that learns the semantic relationships between attacks. Finally, the deep Meta-Learner acts as an ensemble combiner to analyze the hybrid feature space and make a final decision. Our evaluation on stringent benchmark datasets and comparison to existing techniques showed the effectiveness of INFUSE with an F-Score of 0.91, Accuracy of 91.6%, and Recall of 0.94 on the Test+ dataset, and an F-Score of 0.91, Accuracy of 85.6%, and Recall of 0.87 on the stringent Test-21 dataset. These promising results indicate the strong generalization capability and the potential to detect network attacks.


title: When Visible-to-Thermal Facial GAN Beats Conditional Diffusion

abstract: Thermal facial imagery offers valuable insight into physiological states such as inflammation and stress by detecting emitted radiation in the infrared spectrum, which is unseen in the visible spectra. Telemedicine applications could benefit from thermal imagery, but conventional computers are reliant on RGB cameras and lack thermal sensors. As a result, we propose the Visible-to-Thermal Facial GAN (VTF-GAN) that is specifically designed to generate high-resolution thermal faces by learning both the spatial and frequency domains of facial regions, across spectra. We compare VTF-GAN against several popular GAN baselines and the first conditional Denoising Diffusion Probabilistic Model (DDPM) for VT face translation (VTF-Diff). Results show that VTF-GAN achieves high quality, crisp, and perceptually realistic thermal faces using a combined set of patch, temperature, perceptual, and Fourier Transform losses, compared to all baselines including diffusion.


title: Oxygenic photosynthetic responses of cyanobacteria exposed under an M-dwarf starlight simulator: Implications for exoplanet's habitability

abstract: Introduction: The search for life on distant exoplanets is expected to rely on atmospheric biosignatures detection, such as oxygen of biological origin. However, it is not demonstrated how much oxygenic photosynthesis, which on Earth depends on visible light, could work under spectral conditions simulating exoplanets orbiting the Habitable Zone of M-dwarf stars, which have low light emission in the visible and high light emission in the far-red/near-infrared. By utilizing cyanobacteria, the first organisms to evolve oxygenic photosynthesis on our planet, and a starlight simulator capable of accurately reproducing the emission spectrum of an M-dwarf in the range 350-900 nm, we could answer this question. Methods: We performed experiments with the cyanobacterium Chlorogloeopsis fritschii PCC6912, capable of Far-Red Light Photoacclimation (FaRLiP), which allows the strain to harvest far-red in addition to visible light for photosynthesis, and Synechocystis sp. PCC6803, a species unable to perform this photoacclimation, comparing their responses when exposed to three simulated light spectra: M-dwarf, solar and far-red. We analysed growth and photosynthetic acclimation features in terms of pigment composition and photosystems organization. Finally, we determined the oxygen production of the strains directly exposed to the different spectra. Results: Both cyanobacteria were shown to grow and photosynthesize similarly under M-dwarf and solar light conditions: Synechocystis sp. by utilizing the few photons in the visible, C. fritschii by harvesting both visible and far-red light, activating the FaRLiP response.


title: Evaluation of Linear Implicit Quantized State System method for analyzing mission performance of power systems

abstract: The Linear Implicit Quantized State System (LIQSS) method has been evaluated for suitability in modeling and simulation of long-duration mission profiles of Naval power systems which are typically characterized by stiff, nonlinear, differential algebraic equations. A reference electromechanical system consists of an electric machine connected to a torque source on the shaft end and to an electric grid at its electrical terminals. The system is highly non-linear and has widely varying rate constants; at a typical steady state operating point, the electrical and electromechanical time constants differ by three orders of magnitude being 3.2 ms and 2.7 s respectively. Two important characteristics of the simulation, accuracy, and computational intensity both depend on the quantization size of the system state variables. At a quantization size of about 1 percent of a maximum value of a variable, results from the LIQSS1 method differed by less than 1 percent from results computed by well-known continuous system state space methods. The computational efficiency of the LIQSS1 method increased logarithmically with increasing quantization size, without significant loss of accuracy, up to some particular quantization size, beyond which the error increased rapidly. For the particular system under study, a sweet spot was found at a particular quantum size that yielded both high computational efficiency and good accuracy.


title: Dual Nakano positivity and singular Nakano positivity of direct image sheaves

abstract: Let $f:X\to Y$ be a surjective projective map and $L$ be a holomorphic line bundle on $X$ equipped with a (singular) semi-positive Hermitian metric $h$. In this article, by studying the canonical metric on the direct image sheaf of the twisted relative canonical bundles $K_{X/Y}\otimes L\otimes\mathscr{I}(h)$, we obtain that this metric has dual Nakano semi-positivity when $h$ is smooth and there is no deformation by $f$ and that this metric has locally Nakano semi-positivity in the singular sense when $h$ is singular.


title: Hydrophobic homopolymer's coil-globule transition and adsorption onto a hydrophobic surface under different conditions

abstract: Unstructured proteins can modulate cellular responses to environmental conditions by undergoing coil-globule transitions and phase separation. However, the molecular mechanisms of these phenomena still need to be fully understood. Here, we use Monte Carlo calculations of a coarse-grained model incorporating water's effects on the system's free energy. Following previous studies, we model an unstructured protein as a polymer chain. Because we are interested in investigating how it responds to thermodynamic changes near a hydrophobic surface under different conditions, we choose an entirely hydrophobic sequence to maximize the interaction with the interface. We show that a slit pore confinement without top-down symmetry enhances the unfolding and adsorption of the chain in both random coil and globular states. Moreover, we demonstrate that the hydration water modulates this behavior depending on the thermodynamic parameters. Our findings provide insights into how homopolymers, and possibly unstructured proteins, can sense and adjust to external stimuli such as nanointerfaces or stresses.


title: Fairly Predicting Graft Failure in Liver Transplant for Organ Assigning

abstract: Liver transplant is an essential therapy performed for severe liver diseases. The fact of scarce liver resources makes the organ assigning crucial. Model for End-stage Liver Disease (MELD) score is a widely adopted criterion when making organ distribution decisions. However, it ignores post-transplant outcomes and organ/donor features. These limitations motivate the emergence of machine learning (ML) models. Unfortunately, ML models could be unfair and trigger bias against certain groups of people. To tackle this problem, this work proposes a fair machine learning framework targeting graft failure prediction in liver transplant. Specifically, knowledge distillation is employed to handle dense and sparse features by combining the advantages of tree models and neural networks. A two-step debiasing method is tailored for this framework to enhance fairness. Experiments are conducted to analyze unfairness issues in existing models and demonstrate the superiority of our method in both prediction and fairness performance.


title: Symbolic quantum programming for supporting applications of quantum computing technologies

abstract: The goal of this paper is to deliver the overview of the current state of the art, to provide experience report on developing quantum software tools, and to outline the perspective for developing quantum programming tools supporting symbolic programming for the needs of quantum computing technologies. The main focus of this paper is on quantum computing technologies, as they can in the most direct way benefit from developing tools enabling the symbolic manipulation of quantum circuits and providing software tools for creating, optimizing, and testing quantum programs. We deliver a short survey of the most popular approaches in the field of quantum software development and we aim at pointing their strengths and weaknesses. This helps to formulate a list of desirable characteristics which should be included in quantum computing frameworks. Next, we describe a software architecture and its preliminary implementation supporting the development of quantum programs using symbolic approach, encouraging the functional programming paradigm, and, at the same, time enabling the integration with high-performance and cloud computing. The described software consists of several packages developed to address different needs, but nevertheless sharing common design concepts. We also outline how the presented approach could be used in tasks in quantum software engineering, namely quantum software testing and quantum circuit construction.


title: CRP-Tree: A phylogenetic association test for binary traits

abstract: An important problem in evolutionary genomics is to investigate whether a certain trait measured on each sample is associated with the sample phylogenetic tree. The phylogenetic tree represents the shared evolutionary history of the samples and it is usually estimated from molecular sequence data at a locus or from other type of genetic data. We propose a model for trait evolution inspired by the Chinese Restaurant Process that includes a parameter that controls the degree of preferential attachment, that is, the tendency of nodes in the tree to subtend from nodes of the same type. This model with no preferential attachment is equivalent to a structured coalescent model with simultaneous migration and coalescence events and serves as a null model. We derive a test for phylogenetic binary trait association with linear computational complexity and empirically demonstrate that it is more powerful than some other methods. We apply our test to study the phylogenetic association of some traits in swordtail fish, breast cancer, yellow fever virus and influenza A H1N1 virus. R package implementation of our methods is available at $\texttt{https://github.com/jyzhang27/CRPTree}$.


title: Functional Programming and Streams

abstract: This document is intended as a stand-alone textbook chapter to be used for introducing some functional programming concepts into a course in which the primary teaching language is Java. For details of the approach, please see the paper "Functional programming, in the data structures course, in Java" by J. MacCormick, which appears in the Journal of Computing Sciences in Colleges (2023).


title: MorphGANFormer: Transformer-based Face Morphing and De-Morphing

abstract: Semantic face image manipulation has received increasing attention in recent years. StyleGAN-based approaches to face morphing are among the leading techniques; however, they often suffer from noticeable blurring and artifacts as a result of the uniform attention in the latent feature space. In this paper, we propose to develop a transformer-based alternative to face morphing and demonstrate its superiority to StyleGAN-based methods. Our contributions are threefold. First, inspired by GANformer, we introduce a bipartite structure to exploit long-range interactions in face images for iterative propagation of information from latent variables to salient facial features. Special loss functions are designed to support the optimization of face morphing. Second, we extend the study of transformer-based face morphing to demorphing by presenting an effective defense strategy with access to a reference image using the same generator of MorphGANFormer. Such demorphing is conceptually similar to unmixing of hyperspectral images but operates in the latent (instead of pixel) space. Third, for the first time, we address a fundamental issue of vulnerability-detectability trade-off for face morphing studies. It is argued that neither doppelganger norrandom pair selection is optimal, and a Lagrangian multiplier-based approach should be used to achieve an improved trade-off between recognition vulnerability and attack detectability.


title: Doppler-Resilient Universal Filtered MultiCarrier (DR-UFMC): A Beyond-OTFS Modulation

abstract: In the past few years, some alternatives to the Orthogonal Frequency Division Multiplexing (OFDM) modulation have been considered to improve its spectral containment and its performance level in the presence of heavy Doppler shifts. This paper examines a novel modulation, named Doppler-Resilient Universal Filtered MultiCarrier (DR-UFMC), which has the objective of combining the advantages provided by the Universal Filtered MultiCarrier (UFMC) modulation (i.e., better spectral containment), with those of the Orthogonal Time Frequency Space (OTFS) modulation (i.e., better performance in time-varying environments). The paper contains the mathematical model and detailed transceiver block scheme of the newly described modulation, along with a numerical analysis contrasting DR-UFMC against OTFS, OFDM with one-tap frequency domain equalization (FDE), and OFDM with multicarrier multisymbol linear MMSE processing. Results clearly show the superiority, with respect to the cited benchmarks, of the newly proposed modulation in terms of achievable spectral efficiency. Interestingly, it is also seen that OFDM, when considered in conjunction with multicarrier multisymbol linear minimum mean squares error (MMSE) processing, performs slightly better than OTFS in terms of achievable spectral efficiency.


title: {\ae}net-PyTorch: a GPU-supported implementation for machine learning atomic potentials training

abstract: In this work, we present {\ae}net-PyTorch, a PyTorch-based implementation for training artificial neural network-based machine learning interatomic potentials. Developed as an extension of the atomic energy network ({\ae}net), {\ae}net-PyTorch provides access to all the tools included in {\ae}net for the application and usage of the potentials. The package has been designed as an alternative to the internal training capabilities of {\ae}net, leveraging the power of graphic processing units to facilitate direct training on forces in addition to energies. This leads to a substantial reduction of the training time by one to two orders of magnitude compared to the CPU implementation, enabling direct training on forces for systems beyond small molecules. Here we demonstrate the main features of {\ae}net-PyTorch and show its performance on open databases. Our results show that training on all the force information within a data set is not necessary, and including between 10% to 20% of the force information is sufficient to achieve optimally accurate interatomic potentials with the least computational resources.


title: Fractional Marcus-Hush-Chidsey-Yakopcic current-voltage model for redox-based resistive memory devices

abstract: We propose a circuit-level model combining the Marcus-Hush-Chidsey electron current equation and the Yakopcic equation for the state variable for describing resistive switching memory devices of the structure metal-ionic conductor-metal. We extend the dynamics of the state variable originally described by a first-order time derivative by introducing a fractional derivative with an arbitrary order between zero and one. We show that the extended model fits with great fidelity the current-voltage characteristic data obtained on a Si electrochemical metallization memory device with Ag-Cu alloy.


title: Best of Both Worlds Policy Optimization

abstract: Policy optimization methods are popular reinforcement learning algorithms in practice. Recent works have built theoretical foundation for them by proving $\sqrt{T}$ regret bounds even when the losses are adversarial. Such bounds are tight in the worst case but often overly pessimistic. In this work, we show that in tabular Markov decision processes (MDPs), by properly designing the regularizer, the exploration bonus and the learning rates, one can achieve a more favorable polylog$(T)$ regret when the losses are stochastic, without sacrificing the worst-case guarantee in the adversarial regime. To our knowledge, this is also the first time a gap-dependent polylog$(T)$ regret bound is shown for policy optimization. Specifically, we achieve this by leveraging a Tsallis entropy or a Shannon entropy regularizer in the policy update. Then we show that under known transitions, we can further obtain a first-order regret bound in the adversarial regime by leveraging the log-barrier regularizer.


title: RecNet: Early Attention Guided Feature Recovery

abstract: Uncertainty in sensors results in corrupted input streams and hinders the performance of Deep Neural Networks (DNN), which focus on deducing information from data. However, for sensors with multiple input streams, the relevant information among the streams correlates and hence contains mutual information. This paper utilizes this opportunity to recover the perturbed information due to corrupted input streams. We propose RecNet, which estimates the information entropy at every element of the input feature to the network and interpolates the missing information in the input feature matrix. Finally, using the estimated information entropy and interpolated data, we introduce a novel guided replacement procedure to recover the complete information that is the input to the downstream DNN task. We evaluate the proposed algorithm on a sound event detection and localization application where audio streams from the microphone array are corrupted. We have recovered the performance drop due to the corrupted input stream and reduced the localization error with non-corrupted input streams.


title: The Gamma limit of the simple shear problem in nonlinear Cosserat elasticity

abstract: The zero and first order Gamma-limit of vanishing internal length scale are studied for the mechanical energy of a shear problem in geometrically nonlinear Cosserat elasticity. The convergence of the minimizers is shown and the limit functionals are characterized.


title: MultiScale Probability Map guided Index Pooling with Attention-based learning for Road and Building Segmentation

abstract: Efficient road and building footprint extraction from satellite images are predominant in many remote sensing applications. However, precise segmentation map extraction is quite challenging due to the diverse building structures camouflaged by trees, similar spectral responses between the roads and buildings, and occlusions by heterogeneous traffic over the roads. Existing convolutional neural network (CNN)-based methods focus on either enriched spatial semantics learning for the building extraction or the fine-grained road topology extraction. The profound semantic information loss due to the traditional pooling mechanisms in CNN generates fragmented and disconnected road maps and poorly segmented boundaries for the densely spaced small buildings in complex surroundings. In this paper, we propose a novel attention-aware segmentation framework, Multi-Scale Supervised Dilated Multiple-Path Attention Network (MSSDMPA-Net), equipped with two new modules Dynamic Attention Map Guided Index Pooling (DAMIP) and Dynamic Attention Map Guided Spatial and Channel Attention (DAMSCA) to precisely extract the building footprints and road maps from remotely sensed images. DAMIP mines the salient features by employing a novel index pooling mechanism to retain important geometric information. On the other hand, DAMSCA simultaneously extracts the multi-scale spatial and spectral features. Besides, using dilated convolution and multi-scale deep supervision in optimizing MSSDMPA-Net helps achieve stellar performance. Experimental results over multiple benchmark building and road extraction datasets, ensures MSSDMPA-Net as the state-of-the-art (SOTA) method for building and road extraction.


title: Gromov-Witten and Welschinger invariants of del Pezzo varieties

abstract: In this paper, we establish formulas for computing genus-$0$ Gromov-Witten and Welschinger invariants of some del Pezzo varieties of dimension three by comparing to that of dimension two. These formulas are generalizations of that given in three-dimensional projective space by E. Brugall\'e and P. Georgieva in 2016.


title: New Dualities in Linear Systems and Optimal Output Control under Bounded Disturbances

abstract: In this paper, we introduce novel equations that are dual to the ones of the well-known invariant ellipsoids method. These equations yield ellipsoids with newly established geometrical interpretations and connections to linear system norms. The established duality leads to the optimal synthesis results for state-feedback control, filtering, and output-feedback control problems in the presence of bounded disturbances. The proposed output-feedback control solution is demonstrated to be optimal and surpass prior sub-optimal results.


title: Quantum-enhanced performance in superconducting Andreev-reflection engines

abstract: When a quantum dot is attached to a metallic reservoir and a superconducting contact Andreev processes leads to a finite subgap current at the normal lead and the creation or destruction of Cooper pairs. Andreev-reflection engines profit from the destruction of Cooper pairs to provide the work needed to set a charge current at the normal-conductor contact generating electrical power. For this power-transduction device high power and large efficiencies in quantum-mechanically enhanced regimes are demonstrated. There thermodynamic trade-off relations between power, efficiency and stability, valid for any classical engine are overcome, and kinetic constraints on the engine precision are largely surpassed in arbitrary far from equilibrium conditions.


title: Optimal diameter estimates of three-dimensional Ricci limit spaces

abstract: In this note, we prove that positive scalar curvature can pass to three dimensional Ricci limit spaces of non-negative Ricci curvature when it splits off a line. As a corollary, we obtain an optimal Bonnet-Myers type upper bound. Moreover, we obtain a similar statement in all dimensions for Alexandrov spaces of non-negative curvature.


title: Two-dimensional short-range spin-spin correlations in the layered spin-3/2 maple leaf lattice antiferromagnet Na2Mn3O7 with crystal stacking disorder

abstract: We report the nature of magnetic structure, microscopic spin-spin correlations and their dependence on the underlying crystal structure of the geometrically frustrated layered spin-3/2 maple-leaf-lattice (MLL) antiferromagnet Na2Mn3O7 by a comprehensive neutron diffraction study. Crystal structural studies by x-ray and neutron diffractions reveal that the MLL layers (constituted by Mn3O72- units) are well separated by non-magnetic Na layers. The studies also conclude the presence of stacking faults (in-plane sliding of magnetic MLL layers) as well as a distortion in the MLL of Mn4+. Temperature dependent magnetic susceptibility, heat capacity, and neutron diffraction data yield a short-range antiferromagnetic (AFM) ordering below ~ 100 K without a long-range magnetic ordering down to 1.5 K. The analysis of the diffuse magnetic neutron scattering patterns by reverse Monte Carlo method reveals 2D spin-spin correlations within the MLL layers. Additionally, we establish a relation between the correlation length of the short-range magnetic ordering with the stacking faults through a varying synthesis condition. The present study, therefore, explores a microscopic picture of the crystal- and spin-structures, as well as their correlation, hence, provides an experimental insight of the magnetic ordering in a MLL AFM. Further, we have outlined the formation of several 2D frustrated lattice geometry having triangular plaquettes, including the MLL, by crystal engineering of the triangular lattice and their role on the stabilization of multiple novel chiral spin states which opens up a door for study of novel chiral spin states.


title: Physically motivated moment-tensor decomposition for mining-induced seismicity

abstract: Abstract Compared to existing schemes, the decomposition of moment tensors for mining-induced seismic events into closing-crack and double-couple components has the advantage that each can be interpreted in terms of a physical source process (excavation convergence and slip/shear, respectively). Obviously, not every moment tensor permits such a decomposition, and we translate existing bounds on those that do to the Hudson source-type plot. For moment tensors falling within these bounds, it has previously been noted that there will be a infinite set of possible decompositions in general. We derive an implicit equation defining this set and suggest physically motivated criteria that can be used to select a single decomposition from it. Furthermore, for moment tensors falling outside the source-type bounds, we present a simple geometric scheme for determining the closest moment tensor within them (which can then be decomposed). To demonstrate the methods developed in this paper, we apply them to two catalogues of mining-induced seismicity.


title: M-SENSE: Modeling Narrative Structure in Short Personal Narratives Using Protagonist's Mental Representations

abstract: Narrative is a ubiquitous component of human communication. Understanding its structure plays a critical role in a wide variety of applications, ranging from simple comparative analyses to enhanced narrative retrieval, comprehension, or reasoning capabilities. Prior research in narratology has highlighted the importance of studying the links between cognitive and linguistic aspects of narratives for effective comprehension. This interdependence is related to the textual semantics and mental language in narratives, referring to characters' motivations, feelings or emotions, and beliefs. However, this interdependence is hardly explored for modeling narratives. In this work, we propose the task of automatically detecting prominent elements of the narrative structure by analyzing the role of characters' inferred mental state along with linguistic information at the syntactic and semantic levels. We introduce a STORIES dataset of short personal narratives containing manual annotations of key elements of narrative structure, specifically climax and resolution. To this end, we implement a computational model that leverages the protagonist's mental state information obtained from a pre-trained model trained on social commonsense knowledge and integrates their representations with contextual semantic embed-dings using a multi-feature fusion approach. Evaluating against prior zero-shot and supervised baselines, we find that our model is able to achieve significant improvements in the task of identifying climax and resolution.


title: A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT

abstract: Pretrained Foundation Models (PFMs) are regarded as the foundation for various downstream tasks with different data modalities. A PFM (e.g., BERT, ChatGPT, and GPT-4) is trained on large-scale data which provides a reasonable parameter initialization for a wide range of downstream applications. BERT learns bidirectional encoder representations from Transformers, which are trained on large datasets as contextual language models. Similarly, the generative pretrained transformer (GPT) method employs Transformers as the feature extractor and is trained using an autoregressive paradigm on large datasets. Recently, ChatGPT shows promising success on large language models, which applies an autoregressive language model with zero shot or few shot prompting. The remarkable achievements of PFM have brought significant breakthroughs to various fields of AI. Numerous studies have proposed different methods, raising the demand for an updated survey. This study provides a comprehensive review of recent research advancements, challenges, and opportunities for PFMs in text, image, graph, as well as other data modalities. The review covers the basic components and existing pretraining methods used in natural language processing, computer vision, and graph learning. Additionally, it explores advanced PFMs used for different data modalities and unified PFMs that consider data quality and quantity. The review also discusses research related to the fundamentals of PFMs, such as model efficiency and compression, security, and privacy. Finally, the study provides key implications, future research directions, challenges, and open problems in the field of PFMs. Overall, this survey aims to shed light on the research of the PFMs on scalability, security, logical reasoning ability, cross-domain learning ability, and the user-friendly interactive ability for artificial general intelligence.


title: RobustNLP: A Technique to Defend NLP Models Against Backdoor Attacks

abstract: As machine learning (ML) systems are being increasingly employed in the real world to handle sensitive tasks and make decisions in various fields, the security and privacy of those models have also become increasingly critical. In particular, Deep Neural Networks (DNN) have been shown to be vulnerable to backdoor attacks whereby adversaries have access to the training data and the opportunity to manipulate such data by inserting carefully developed samples into the training dataset. Although the NLP community has produced several studies on generating backdoor attacks proving the vulnerable state of language modes, to the best of our knowledge, there does not exist any work to combat such attacks. To bridge this gap, we present RobustEncoder: a novel clustering-based technique for detecting and removing backdoor attacks in the text domain. Extensive empirical results demonstrate the effectiveness of our technique in detecting and removing backdoor triggers. Our code is available at https://github.com/marwanomar1/Backdoor-Learning-for-NLP


title: Microfoundations of Expected Utility and Response Times

abstract: This paper builds a rule for decisionmaking from the physical behavior of single neurons, the well established neural circuitry of mutual inhibition, and the evolutionary principle of natural selection. No axioms are used in the derivation of this rule. The paper provides a microfoundation to both Economics Choice Theory and Cognitive Psychologys Response Times Theory. The paper finds how classical expected utility should be modified to account for much neuroscientific evidence, and how neuroscientific correlates of choice should be linked to utility. In particular, the model implies the concept of utility is a network property and cannot be calculated as a function of frequencies in one layer of neurons alone; it requires understanding how different layers work together. The resulting rule is simple enough to model markets and games as is customary in the social sciences. Utility maximization and inaction are endogenous to the model, cardinality and independence of irrelevant alternatives, properties present in classical and random utility theories, are only met in limiting situations.


title: Neural Attention Memory

abstract: We propose a novel perspective of the attention mechanism by reinventing it as a memory architecture for neural networks, namely Neural Attention Memory (NAM). NAM is a memory structure that is both readable and writable via differentiable linear algebra operations. We explore three use cases of NAM: memory-augmented neural network (MANN), few-shot learning, and efficient long-range attention. First, we design two NAM-based MANNs of Long Short-term Memory (LSAM) and NAM Turing Machine (NAM-TM) that show better computational powers in algorithmic zero-shot generalization tasks compared to other baselines such as differentiable neural computer (DNC). Next, we apply NAM to the N-way K-shot learning task and show that it is more effective at reducing false positives compared to the baseline cosine classifier. Finally, we implement an efficient Transformer with NAM and evaluate it with long-range arena tasks to show that NAM can be an efficient and effective alternative for scaled dot-product attention.


title: A new notion of subharmonicity on locally smoothing spaces, and a conjecture by Braverman, Milatovic, Shubin

abstract: Given a strongly local Dirichlet space and $\lambda\geq 0$, we introduce a new notion of $\lambda$--subharmonicity for $L^1_\loc$--functions, which we call \emph{local $\lambda$--shift defectivity}, and which turns out to be equivalent to distributional $\lambda$--subharmonicity in the Riemannian case. We study the regularity of these functions on a new class of strongly local Dirichlet, so called locally smoothing spaces, which includes Riemannian manifolds (without any curvature assumptions), finite dimensional RCD spaces, Carnot groups, and Sierpinski gaskets. As a byproduct of this regularity theory, we obtain in this general framework a proof of a conjecture by Braverman, Milatovic, Shubin on the positivity of distributional $L^q$-solutions of $\Delta f\leq f$ for complete Riemannian manifolds.


title: Zero and Few-Shot Localization of Task-Oriented Dialogue Agents with a Distilled Representation

abstract: Task-oriented Dialogue (ToD) agents are mostly limited to a few widely-spoken languages, mainly due to the high cost of acquiring training data for each language. Existing low-cost approaches that rely on cross-lingual embeddings or naive machine translation sacrifice a lot of accuracy for data efficiency, and largely fail in creating a usable dialogue agent. We propose automatic methods that use ToD training data in a source language to build a high-quality functioning dialogue agent in another target language that has no training data (i.e. zero-shot) or a small training set (i.e. few-shot). Unlike most prior work in cross-lingual ToD that only focuses on Dialogue State Tracking (DST), we build an end-to-end agent. We show that our approach closes the accuracy gap between few-shot and existing full-shot methods for ToD agents. We achieve this by (1) improving the dialogue data representation, (2) improving entity-aware machine translation, and (3) automatic filtering of noisy translations. We evaluate our approach on the recent bilingual dialogue dataset BiToD. In Chinese to English transfer, in the zero-shot setting, our method achieves 46.7% and 22.0% in Task Success Rate (TSR) and Dialogue Success Rate (DSR) respectively. In the few-shot setting where 10% of the data in the target language is used, we improve the state-of-the-art by 15.2% and 14.0%, coming within 5% of full-shot training.


title: A Neurodiversity-Inspired Solver for the Abstraction \& Reasoning Corpus (ARC) Using Visual Imagery and Program Synthesis

abstract: Core knowledge about physical objects -- e.g., their permanency, spatial transformations, and interactions -- is one of the most fundamental building blocks of biological intelligence across humans and non-human animals. While AI techniques in certain domains (e.g. vision, NLP) have advanced dramatically in recent years, no current AI systems can yet match human abilities in flexibly applying core knowledge to solve novel tasks. We propose a new AI approach to core knowledge that combines 1) visual representations of core knowledge inspired by human mental imagery abilities, especially as observed in studies of neurodivergent individuals; with 2) tree-search-based program synthesis for flexibly combining core knowledge to form new reasoning strategies on the fly. We demonstrate our system's performance on the very difficult Abstraction \& Reasoning Corpus (ARC) challenge, and we share experimental results from publicly available ARC items as well as from our 4th-place finish on the private test set during the 2022 global ARCathon challenge.


title: Security of IT/OT Convergence: Design and Implementation Challenges

abstract: IoT is undoubtedly considered the future of the Internet. Many sectors are moving towards the use of these devices to aid better monitoring, controlling of the surrounding environment, and manufacturing processes. The Industrial Internet of things is a sub-domain of IoT and serves as enablers of the industry. IIoT is providing valuable services to Industrial Control Systems such as logistics, manufacturing, healthcare, industrial surveillance, and others. Although IIoT service-offering to ICS is tempting, it comes with greater risk. ICS systems are protected by isolation and creating an air-gap to separate their network from the outside world. While IIoT by definition is a device that has connection ability. This creates multiple points of entry to a closed system. In this study, we examine the first automated risk assessment system designed specifically to deal with the automated risk assessment and defining potential threats associated with IT/OT convergence based on OCTAVE Allegro- ISO/IEC 27030 Frameworks.


title: Multiplayer War of Attrition with Asymmetric Private Information

abstract: This paper studies a war of attrition game in the setting of public good provision that combines three elements: (i) multiple players, (ii) incomplete information, and (iii) ex-ante asymmetry. In the unique equilibrium, asymmetry leads to a stratified behavior pattern where one player provides the public good instantly with a positive probability while each of the other players has a player-specific strict waiting time, before which even his highest type will not provide the good. Comparative statics show that a player with less patience, lower cost of provision, and higher reputation in value (expressed in a form of hazard rate) provides the good type-wise uniformly faster. In large societies, the cost of delay is mainly determined by the highest type of the instant-exit player.


title: Cyclicity of the 2-class group of the first Hilbert 2-class field of some number fields

abstract: Let $\mathds{k}$ be a real quadratic number field. Denote by $\mathrm{Cl}_2(\mathds{k})$ its $2$-class group and by $\mathds{k}_2^{(1)}$ (resp. $\mathds{k}_2^{(2)}$) its first (resp. second) Hilbert $2$-class field. The aim of this paper is to study, for a real quadratic number field whose discriminant is divisible by one prime number congruent to $3$ modulo 4, the metacyclicity of $G=\mathrm{Gal}(\mathds{k}_2^{(2)}/\mathds{k})$ and the cyclicity of $\mathrm{Gal}(\mathds{k}_2^{(2)}/\mathds{k}_2^{(1)})$ whenever the rank of $\mathrm{Cl}_2(\mathds{k})$ is $2$, and the $4$-rank of $\mathrm{Cl}_2(\mathds{k})$ is $1$.


title: NU-AIR -- A Neuromorphic Urban Aerial Dataset for Detection and Localization of Pedestrians and Vehicles

abstract: This paper presents an open-source aerial neuromorphic dataset that captures pedestrians and vehicles moving in an urban environment. The dataset, titled NU-AIR, features 70.75 minutes of event footage acquired with a 640 x 480 resolution neuromorphic sensor mounted on a quadrotor operating in an urban environment. Crowds of pedestrians, different types of vehicles, and street scenes featuring busy urban environments are captured at different elevations and illumination conditions. Manual bounding box annotations of vehicles and pedestrians contained in the recordings are provided at a frequency of 30 Hz, yielding 93,204 labels in total. Evaluation of the dataset's fidelity is performed through comprehensive ablation study for three Spiking Neural Networks (SNNs) and training ten Deep Neural Networks (DNNs) to validate the quality and reliability of both the dataset and corresponding annotations. All data and Python code to voxelize the data and subsequently train SNNs/DNNs has been open-sourced.


title: Thermo-osmosis in charged nanochannels: effects of surface charge and ionic strength

abstract: Thermo-osmosis refers to fluid migration due to temperature gradient. The mechanistic understanding of thermo-osmosis in charged nano-porous media is still incomplete, while it is important for several environmental and energy applications, such as low-grade waste heat recovery, wastewater recovery, fuel cells, and nuclear waste storage. This paper presents results from a series of molecular dynamics simulations of thermo-osmosis in charged silica nanochannels that advance the understanding of the phenomenon. Simulations with pure water and water with dissolved NaCl are considered. First, the effect of surface charge on the sign and magnitude of the thermo-osmotic coefficient is quantified. This effect was found to be mainly linked to the structural modifications of aqueous electrical double layer (EDL) caused by the nanoconfinement and surface charges. In addition, the results illustrate that the surface charges reduce the self-diffusivity and thermo-osmosis of interfacial liquid. The thermo-osmosis was found to change direction when the surface charge density exceeds $-0.03 C/m^2$. It was found that the thermo-osmotic flow and self-diffusivity increases with the concentration of NaCl. The fluxes of solvent and solute are decoupled by considering the Ludwig-Soret effect of NaCl ions to identify the main mechanisms controlling the behavior. In addition to the advance in microscopic quantification and mechanistic understanding of thermo-osmosis, the work provides approaches to investigate a broader category of coupled heat and mass transfer problems in nanoscale space.


title: Beam Dynamics in Independent Phased Cavities

abstract: Linear accelerators containing the sequence of independently phased cavities with constant geometrical velocity along each structure are widely used in practice. The chain of cavities with identical cell lengths is utilized within a certain beam velocity range, with subsequent transformation to the next chain with higher cavity velocity. Design and analysis of beam dynamics in this type of accelerator are usually performed using numerical simulations. A full theoretical description of particle acceleration in an array of independent phased cavities has not been developed. In the present paper, we provide an analytical treatment of beam dynamics in such linacs employing Hamiltonian formalism. We begin our analysis with an examination of beam dynamics in an equivalent traveling wave of a single cavity, propagating within accelerating section with constant phase velocity. We then consider beam dynamics in arrays of cavities, utilizing an effective traveling wave propagating along with the whole accelerator with the velocity of synchronous (reference) particle. The analysis concluded with the determination of the matched beam conditions. Finally, we present a beam dynamics study in 805 MHz Coupled Cavity Linac of the LANSCE accelerator facility.


title: BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmark

abstract: To advance Chinese financial natural language processing (NLP), we introduce BBT-FinT5, a new Chinese financial pre-training language model based on the T5 model. To support this effort, we have built BBT-FinCorpus, a large-scale financial corpus with approximately 300GB of raw text from four different sources. In general domain NLP, comprehensive benchmarks like GLUE and SuperGLUE have driven significant advancements in language model pre-training by enabling head-to-head comparisons among models. Drawing inspiration from these benchmarks, we propose BBT-CFLEB, a Chinese Financial Language understanding and generation Evaluation Benchmark, which includes six datasets covering both understanding and generation tasks. Our aim is to facilitate research in the development of NLP within the Chinese financial domain. Our model, corpus and benchmark are released at https://github.com/ssymmetry/BBT-FinCUGE-Applications. Our work belongs to the Big Bang Transformer (BBT), a large-scale pre-trained language model project.


title: The Generalization Error of Stochastic Mirror Descent on Over-Parametrized Linear Models

abstract: Despite being highly over-parametrized, and having the ability to fully interpolate the training data, deep networks are known to generalize well to unseen data. It is now understood that part of the reason for this is that the training algorithms used have certain implicit regularization properties that ensure interpolating solutions with "good" properties are found. This is best understood in linear over-parametrized models where it has been shown that the celebrated stochastic gradient descent (SGD) algorithm finds an interpolating solution that is closest in Euclidean distance to the initial weight vector. Different regularizers, replacing Euclidean distance with Bregman divergence, can be obtained if we replace SGD with stochastic mirror descent (SMD). Empirical observations have shown that in the deep network setting, SMD achieves a generalization performance that is different from that of SGD (and which depends on the choice of SMD's potential function. In an attempt to begin to understand this behavior, we obtain the generalization error of SMD for over-parametrized linear models for a binary classification problem where the two classes are drawn from a Gaussian mixture model. We present simulation results that validate the theory and, in particular, introduce two data models, one for which SMD with an $\ell_2$ regularizer (i.e., SGD) outperforms SMD with an $\ell_1$ regularizer, and one for which the reverse happens.


title: Ferroelastic toughening: can it solve the mechanics challenges of solid electrolytes?

abstract: The most promising solid electrolytes for all-solid-state Li batteries are oxide and sulfide ceramics. Current ceramic solid electrolytes are brittle and lack the toughness to withstand the mechanical stresses of repeated charge and discharge cycles. Solid electrolytes are susceptible to crack propagation due to dendrite growth from Li metal anodes and to debonding processes at the cathode/electrolyte interface due to cyclic variations in the cathode lattice parameters. In this perspective, we argue that solutions to the mechanics challenges of all-solid-state batteries can be borrowed from the aerospace industry, which successfully overcame similar hurdles in the development of thermal barrier coatings of superalloy turbine blades. Their solution was to exploit ferroelastic and transformation toughening mechanisms to develop ceramics that can withstand cyclic stresses due to large variations in temperature. This perspective describes fundamental materials design principles with which to search for solid electrolytes that are ferroelastically toughened.


title: Restricted analytic valued fields with partial exponentiation

abstract: Non-archimedean fields with restricted analytic functions may not support a full exponential function, but they always have partial exponentials defined in convex subrings. On face of this, we study the first order theory of the class of non-archimedean ordered valued fields augmented by all restricted analytic functions and an exponential function defined in the valuation ring, which extends the restricted analytic exponential. We obtain model completeness and other desirable properties for this theory. In particular, any model embeds in a model where the partial exponential extends to a full one.


title: Rarefied Thue-Morse Sums Via Automata Theory and Logic

abstract: Let $t(n)$ denote the number of $1$-bits in the base-$2$ representation of $n$, taken modulo $2$. We show how to prove the classic conjecture of Leo Moser, on the rarefied sum $\sum_{0\leq i<n} (-1)^{t(3i)}$, using tools from automata theory and logic. The same technique can be used to prove results about analogous sums.


title: RobustDistiller: Compressing Universal Speech Representations for Enhanced Environment Robustness

abstract: Self-supervised speech pre-training enables deep neural network models to capture meaningful and disentangled factors from raw waveform signals. The learned universal speech representations can then be used across numerous downstream tasks. These representations, however, are sensitive to distribution shifts caused by environmental factors, such as noise and/or room reverberation. Their large sizes, in turn, make them unfeasible for edge applications. In this work, we propose a knowledge distillation methodology termed RobustDistiller which compresses universal representations while making them more robust against environmental artifacts via a multi-task learning objective. The proposed layer-wise distillation recipe is evaluated on top of three well-established universal representations, as well as with three downstream tasks. Experimental results show the proposed methodology applied on top of the WavLM Base+ teacher model outperforming all other benchmarks across noise types and levels, as well as reverberation times. Oftentimes, the obtained results with the student model (24M parameters) achieved results inline with those of the teacher model (95M).


title: Does Machine Learning Amplify Pricing Errors in the Housing Market? -- The Economics of Machine Learning Feedback Loops

abstract: Machine learning algorithms are increasingly employed to price or value homes for sale, properties for rent, rides for hire, and various other goods and services. Machine learning-based prices are typically generated by complex algorithms trained on historical sales data. However, displaying these prices to consumers anchors the realized sales prices, which will in turn become training samples for future iterations of the algorithms. The economic implications of this machine learning "feedback loop" - an indirect human-algorithm interaction - remain relatively unexplored. In this work, we develop an analytical model of machine learning feedback loops in the context of the housing market. We show that feedback loops lead machine learning algorithms to become overconfident in their own accuracy (by underestimating its error), and leads home sellers to over-rely on possibly erroneous algorithmic prices. As a consequence at the feedback loop equilibrium, sale prices can become entirely erratic (relative to true consumer preferences in absence of ML price interference). We then identify conditions (choice of ML models, seller characteristics and market characteristics) where the economic payoffs for home sellers at the feedback loop equilibrium is worse off than no machine learning. We also empirically validate primitive building blocks of our analytical model using housing market data from Zillow. We conclude by prescribing algorithmic corrective strategies to mitigate the effects of machine learning feedback loops, discuss the incentives for platforms to adopt these strategies, and discuss the role of policymakers in regulating the same.


title: Emergence of synchronised rotations in dense active matter with disorder

abstract: We consider the rich variety of collective motion patterns emerging when aligning active particles move in the presence of randomly distributed obstacles - representing quenched noise in two dimensions. In order to get insight into the involved complex flows and the transitions between them we use a simple model allowing the observation and analysis of behaviors that are less straightforwardly accessible by experiments or analytic calculations. We find a series of symmetry breaking states in spite of the applied disorder being isotropic. In particular, as the level of perturbations is increased, the system of self-propelled particles changes its collective motion patterns from i) directed flow ii) through a mixed state of locally directed or locally rotating flow to iii) a novel, globally synchronized rotating state thereby the system violating overall chiral symmetry. Finally, this phase crosses over to a state in which iv) clusters of locally synchronized rotations are observed. The way of change from polar flow to overall synchronization can be interpreted as indicating a non-reciprocal phase transition. Our simulations suggest that when both present, quenched rather than shot noise dominates the behaviors.


title: Online Continuous Hyperparameter Optimization for Generalized Linear Contextual Bandits

abstract: In stochastic contextual bandits, an agent sequentially makes actions from a time-dependent action set based on past experience to minimize the cumulative regret. Like many other machine learning algorithms, the performance of bandits heavily depends on the values of hyperparameters, and theoretically derived parameter values may lead to unsatisfactory results in practice. Moreover, it is infeasible to use offline tuning methods like cross-validation to choose hyperparameters under the bandit environment, as the decisions should be made in real-time. To address this challenge, we propose the first online continuous hyperparameter tuning framework for contextual bandits to learn the optimal parameter configuration in practice within a search space on the fly. Specifically, we use a double-layer bandit framework named CDT (Continuous Dynamic Tuning) and formulate the hyperparameter optimization as a non-stationary continuum-armed bandit, where each arm represents a combination of hyperparameters, and the corresponding reward is the algorithmic result. For the top layer, we propose the Zooming TS algorithm that utilizes Thompson Sampling (TS) for exploration and a restart technique to get around the \textit{switching} environment. The proposed CDT framework can be easily utilized to tune contextual bandit algorithms without any pre-specified candidate set for multiple hyperparameters. We further show that it could achieve a sublinear regret in theory and performs consistently better than all existing methods on both synthetic and real datasets.


title: Search for universal minimum drag resistance underwater vehicle hull using CFD

abstract: In Autonomous Underwater Vehicles (AUVs) design, hull resistance is an important factor in determining the power requirements and range of vehicle and consequently affect battery size, weight, and volume requirement of the design. In this paper, we leverage on AI-based optimization algorithm along with Computational Fluid Dynamics (CFD) simulation to study the optimal hull design that minimizing the resistance. By running the CFD-based optimization at different operating velocities and turbulence intensity, we want to study/search the possibility of a universal design that will provide least resistance/near-optimal design across all operating conditions (operating velocity) and environmental conditions (turbulence intensity). Early result demonstrated that the optimal design found at low velocity and low turbulence condition performs very poor at high velocity and high turbulence conditions. However, a design that is optimal at high velocity and high turbulence conditions performs near-optimal across many considered velocity and turbulence conditions.


title: Charge and Energy Transfer Dynamics of Hybridized Exciton-Polaritons in 2D Halide Perovskites

abstract: Excitons, bound electron-hole pairs, in Two-Dimensional Hybrid Organic Inorganic Perovskites (2D HOIPs) are capable of forming hybrid light-matter states known as exciton-polaritons (E-Ps) when the excitonic medium is confined in an optical cavity. In the case of 2D HOIPs, they can self-hybridize into E-Ps at specific thicknesses of the HOIP crystals that form a resonant optical cavity with the excitons. However, the fundamental properties of these self-hybridized E-Ps in 2D HOIPs, including their role in ultrafast energy and/or charge transfer at interfaces, remain unclear. Here, we demonstrate that > 0.5 um thick 2D HOIP crystals on Au substrates are capable of supporting multiple-orders of self-hybridized E-P modes. These E-Ps have high Q factors (> 100) and modulate the optical dispersion for the crystal to enhance sub-gap absorption and emission. Through varying excitation energy and ultrafast measurements, we also confirm energy transfer from higher energy upper E-Ps to lower energy, lower E-Ps. Finally, we also demonstrate that E-Ps are capable of charge transport and transfer at interfaces. Our findings provide new insights into charge and energy transfer in E-Ps opening new opportunities towards their manipulation for polaritonic devices.

categories: cond-mat.mes-hall cond-mat.mtrl-sci physics.app-ph physics.optics


title: VITAL: Vision Transformer Neural Networks for Accurate Smartphone Heterogeneity Resilient Indoor Localization

abstract: Wi-Fi fingerprinting-based indoor localization is an emerging embedded application domain that leverages existing Wi-Fi access points (APs) in buildings to localize users with smartphones. Unfortunately, the heterogeneity of wireless transceivers across diverse smartphones carried by users has been shown to reduce the accuracy and reliability of localization algorithms. In this paper, we propose a novel framework based on vision transformer neural networks called VITAL that addresses this important challenge. Experiments indicate that VITAL can reduce the uncertainty created by smartphone heterogeneity while improving localization accuracy from 41% to 68% over the best-known prior works. We also demonstrate the generalizability of our approach and propose a data augmentation technique that can be integrated into most deep learning-based localization frameworks to improve accuracy.


title: mBEST: Realtime Deformable Linear Object Detection Through Minimal Bending Energy Skeleton Pixel Traversals

abstract: Robotic manipulation of deformable materials is a challenging task that often requires realtime visual feedback. This is especially true for deformable linear objects (DLOs) or "rods", whose slender and flexible structures make proper tracking and detection nontrivial. To address this challenge, we present mBEST, a robust algorithm for the realtime detection of DLOs that is capable of producing an ordered pixel sequence of each DLO's centerline along with segmentation masks. Our algorithm obtains a binary mask of the DLOs and then thins it to produce a skeleton pixel representation. After refining the skeleton to ensure topological correctness, the pixels are traversed to generate paths along each unique DLO. At the core of our algorithm, we postulate that intersections can be robustly handled by choosing the combination of paths that minimizes the cumulative bending energy of the DLO(s). We show that this simple and intuitive formulation outperforms the state-of-the-art methods for detecting DLOs with large numbers of sporadic crossings ranging from curvatures with high variance to nearly-parallel configurations. Furthermore, our method achieves a significant performance improvement of approximately 50% faster runtime and better scaling over the state of the art.