title: Semiconductor thermal and electrical properties decoupled by localized phonon resonances

abstract: Thermoelectric materials convert heat into electricity through thermally driven charge transport in solids, or vice versa for cooling. To be competitive with conventional energy-generation technologies, a thermoelectric material must possess the properties of both an electrical conductor and a thermal insulator. However, these properties are normally mutually exclusive because of the interconnection of the scattering mechanisms for charge carriers and phonons. Recent theoretical investigations on sub-device scales have revealed that silicon membranes covered by nanopillars exhibit a multitude of local phonon resonances, spanning the full spectrum, that couple with the heat-carrying phonons in the membrane and collectively cause a reduction in the in-plane thermal conductivity$-$while, in principle, not affecting the electrical properties because the nanopillars are external to the pathway of voltage generation and charge transport. Here this effect is demonstrated experimentally for the first time by investigating device-scale suspended silicon membranes with GaN nanopillars grown on the surface. The nanopillars cause up to 21 % reduction in the thermal conductivity while the electrical conductivity and the Seebeck coefficient remain unaffected, thus demonstrating an unprecedented decoupling in the semiconductor's thermoelectric properties. The measured thermal conductivity behavior for coalesced nanopillars and corresponding lattice-dynamics calculations provide further evidence that the reductions are mechanistically tied to the phonon resonances. This finding breaks a longstanding trade-off between competing properties in thermoelectricity and paves the way for engineered high-efficiency solid-state energy recovery and cooling.


title: KAER: A Knowledge Augmented Pre-Trained Language Model for Entity Resolution

abstract: Entity resolution has been an essential and well-studied task in data cleaning research for decades. Existing work has discussed the feasibility of utilizing pre-trained language models to perform entity resolution and achieved promising results. However, few works have discussed injecting domain knowledge to improve the performance of pre-trained language models on entity resolution tasks. In this study, we propose Knowledge Augmented Entity Resolution (KAER), a novel framework named for augmenting pre-trained language models with external knowledge for entity resolution. We discuss the results of utilizing different knowledge augmentation and prompting methods to improve entity resolution performance. Our model improves on Ditto, the existing state-of-the-art entity resolution method. In particular, 1) KAER performs more robustly and achieves better results on "dirty data", and 2) with more general knowledge injection, KAER outperforms the existing baseline models on the textual dataset and dataset from the online product domain. 3) KAER achieves competitive results on highly domain-specific datasets, such as citation datasets, requiring the injection of expert knowledge in future work.


title: Variational Inference: Posterior Threshold Improves Network Clustering Accuracy in Sparse Regimes

abstract: Variational inference has been widely used in machine learning literature to fit various Bayesian models. In network analysis, this method has been successfully applied to solve the community detection problems. Although these results are promising, their theoretical support is only for relatively dense networks, an assumption that may not hold for real networks. In addition, it has been shown recently that the variational loss surface has many saddle points, which may severely affect its performance, especially when applied to sparse networks. This paper proposes a simple way to improve the variational inference method by hard thresholding the posterior of the community assignment after each iteration. Using a random initialization that correlates with the true community assignment, we show that the proposed method converges and can accurately recover the true community labels, even when the average node degree of the network is bounded. Extensive numerical study further confirms the advantage of the proposed method over the classical variational inference and another state-of-the-art algorithm.


title: Climbing the Cliffs: Classifying YSOs in the Cosmic Cliffs JWST Data using a Probabilistic Random Forest

abstract: Among the first observations released to the public from the James Webb Space Telescope (JWST) was a section of the star-forming region NGC 3324 known colloquially as the "Cosmic Cliffs." We build a photometric catalog of the region and test the ability of using the Probabilistic Random Forest machine learning method to identify its Young Stellar Objects (YSOs). We find 450 candidate YSOs (cYSOs) out of 19~497 total objects within the field, 413 of which are cYSOs not found in previous works. These classifications are verified with several different metrics, including recall and precision. Using the obtained probabilities of objects being YSOs, we employ a Monte Carlo approach to determine the surface density of cYSOs in the Cosmic Cliffs, which we find to be largely coincident with column densities derived from Herschel data, up to a column density of 1.37 $\times$ 10$^{22}$ cm$^{-2}$. The newly determined number and spatial distribution of YSOs in the Cosmic Cliffs demonstrate that JWST is far more capable of detecting YSOs in dusty regions than Spitzer. Comparisons of the observed colors and brightness of faint cYSOs with those of pre-main-sequence models suggest JWST has detected a significant population of sub-stellar YSOs in the Cosmic Cliffs. The size of this population further suggests previous estimates of star formation efficiencies in molecular clouds have been systematically low.


title: Spectral form factor in the $\tau$-scaling limit

abstract: We study the spectral form factor (SFF) of general topological gravity in the limit of large time and fixed temperature. It has been observed recently that in this limit, called the tau-scaling limit, the genus expansion of the SFF can be summed up and the late-time behavior of the SFF such as the ramp-plateau transition can be studied analytically. In this paper we develop a technique for the systematic computation of the higher order corrections to the SFF in the strict tau-scaling limit. We obtain the first five corrections in a closed form for the general background of topological gravity. As concrete examples, we present the results for the Airy case and Jackiw-Teitelboim gravity. We find that the above higher order corrections are the Fourier transforms of the corrections to the sine-kernel approximation of the Christoffel-Darboux kernel in the dual double-scaled matrix integral, which naturally explains their structure. Along the way we also develop a technique for the systematic computation of the corrections to the sine-kernel formula, which have not been fully explored in the literature before.


title: A Decentralized Pilot Assignment Algorithm for Scalable O-RAN Cell-Free Massive MIMO

abstract: Radio access networks (RANs) in monolithic architectures have limited adaptability to supporting different network scenarios. Recently, open-RAN (O-RAN) techniques have begun adding enormous flexibility to RAN implementations. O-RAN is a natural architectural fit for cell-free massive multiple-input multiple-output (CFmMIMO) systems, where many geographically-distributed access points (APs) are employed to achieve ubiquitous coverage and enhanced user performance. In this paper, we address the decentralized pilot assignment (PA) problem for scalable O-RAN-based CFmMIMO systems. We propose a low-complexity PA scheme using a multi-agent deep reinforcement learning (MA-DRL) framework in which multiple learning agents perform distributed learning over the O-RAN communication architecture to suppress pilot contamination. Our approach does not require prior channel knowledge but instead relies on real-time interactions made with the environment during the learning procedure. In addition, we design a codebook search (CS) scheme that exploits the decentralization of our O-RAN CFmMIMO architecture, where different codebook sets can be utilized to further improve PA performance without any significant additional complexities. Numerical evaluations verify that our proposed scheme provides substantial computational scalability advantages and improvements in channel estimation performance compared to the state-of-the-art.


title: On Phase Change Rate Maximization with Practical Applications

abstract: We recapitulate the notion of phase change rate maximization and demonstrate the usefulness of its solution on analyzing the robust instability of a cyclic network of multi-agent systems subject to a homogenous multiplicative perturbation. Subsequently, we apply the phase change rate maximization result to two practical applications. The first is a magnetic levitation system, while the second is a repressilator with time-delay in synthetic biology.


title: A Framework for Generalization and Transportation of Causal Estimates Under Covariate Shift

abstract: Randomized experiments are an excellent tool for estimating internally valid causal effects with the sample at hand, but their external validity is frequently debated. While classical results on the estimation of Population Average Treatment Effects (PATE) implicitly assume random selection into experiments, this is typically far from true in many medical, social-scientific, and industry experiments. When the experimental sample is different from the target sample along observable or unobservable dimensions, experimental estimates may be of limited use for policy decisions. We begin by decomposing the extrapolation bias from estimating the Target Average Treatment Effect (TATE) using the Sample Average Treatment Effect (SATE) into covariate shift, overlap, and effect modification components, which researchers can reason about in order to diagnose the severity of extrapolation bias. Next, We cast covariate shift as a sample selection problem and propose estimators that re-weight the doubly-robust scores from experimental subjects to estimate treatment effects in the overall sample (=: generalization) or in an alternate target sample (=: transportation). We implement these estimators in the open-source R package causalTransportR and illustrate its performance in a simulation study and discuss diagnostics to evaluate its performance.


title: Quantum critical phase of FeO spans conditions of Earth's lower mantle

abstract: Earth's interior consists primarily of an insulating rocky mantle and a metallic iron-dominant core. Recent work has shown that mountain-scale structures at the core-mantle boundary may be highly enriched in FeO reported to exhibit high conductivity and metallic behavior at extreme pressure-temperature (P-T) conditions. However, the underlying electronic processes in FeO remain poorly understood and controversial. Here we systematically explore the electronic structure of B1-FeO at extreme conditions with large-scale theoretical modeling using state-of-the-art embedded dynamical mean field theory (eDMFT). Fine sampling of the phase diagram at more than 350 volume-temperature conditions reveals that, instead of sharp metallization, compression of FeO at high temperatures induces a gradual orbitally selective insulator-metal transition. Specifically, at P-T conditions of the lower mantle, FeO exists in an intermediate "quantum critical" state, characteristic of strongly correlated electronic matter. Transport in this regime, distinct from insulating or metallic behavior, is marked by incoherent diffusion of electrons in the conducting t_{2g} orbital and a band gap in the e_g orbital, resulting in moderate electrical conductivity (~ 10^5 S/m) with modest P -T dependence as observed in experiments. FeO-rich regions in Earth's lowermost mantle could thus influence electromagnetic interactions between the mantle and the core, producing several features observed in Earth's rotation and magnetic field evolution.


title: Broad-Range Directional Detection of Light Dark Matter in Cryogenic Ice

abstract: We propose hexagonal ice (H$_2$O) as a new target for light dark matter (DM) direct detection. Ice, a polar material, is suitable for single phonon detection through DM scattering for which we consider light dark photon and light scalar mediator models. We report a rate sensitivity down to a DM mass of $\sim$keV, constituting a broader mass range than other promising candidates. We find better sensitivity for near-term experimental thresholds from the presence of high-frequency phonons. These advantages, and ice's availability, make it highly promising for single-phonon detection.


title: Direction-sensitive dark matter search with three-dimensional vector-type tracking in NEWAGE

abstract: NEWAGE is a direction-sensitive dark matter search experiment with a three-dimensional tracking detector based on a gaseous micro time projection chamber. A direction-sensitive dark matter search was carried out at Kamioka Observatory with a total live time of 318.0 days resulting in an exposure of 3.18 kg$\cdot$days. A new gamma-ray rejection and a head-tail determination analysis were implemented for this work. No significant non-isotropic signal from the directional analysis was found and a 90% confidence level upper limit on spin-dependent WIMP-proton cross section of 25.7 pb for WIMP mass of 150 GeV/c2 was derived. This upper limit is the most stringent in the direction-sensitive dark matter searches.


title: Much Ado About Gender: Current Practices and Future Recommendations for Appropriate Gender-Aware Information Access

abstract: Information access research (and development) sometimes makes use of gender, whether to report on the demographics of participants in a user study, as inputs to personalized results or recommendations, or to make systems gender-fair, amongst other purposes. This work makes a variety of assumptions about gender, however, that are not necessarily aligned with current understandings of what gender is, how it should be encoded, and how a gender variable should be ethically used. In this work, we present a systematic review of papers on information retrieval and recommender systems that mention gender in order to document how gender is currently being used in this field. We find that most papers mentioning gender do not use an explicit gender variable, but most of those that do either focus on contextualizing results of model performance, personalizing a system based on assumptions of user gender, or auditing a model's behavior for fairness or other privacy-related issues. Moreover, most of the papers we review rely on a binary notion of gender, even if they acknowledge that gender cannot be split into two categories. We connect these findings with scholarship on gender theory and recent work on gender in human-computer interaction and natural language processing. We conclude by making recommendations for ethical and well-grounded use of gender in building and researching information access systems.


title: Bug Hunters' Perspectives on the Challenges and Benefits of the Bug Bounty Ecosystem

abstract: Although researchers have characterized the bug-bounty ecosystem from the point of view of platforms and programs, minimal effort has been made to understand the perspectives of the main workers: bug hunters. To improve bug bounties, it is important to understand hunters' motivating factors, challenges, and overall benefits. We address this research gap with three studies: identifying key factors through a free listing survey (n=56), rating each factor's importance with a larger-scale factor-rating survey (n=159), and conducting semi-structured interviews to uncover details (n=24). Of 54 factors that bug hunters listed, we find that rewards and learning opportunities are the most important benefits. Further, we find scope to be the top differentiator between programs. Surprisingly, we find earning reputation to be one of the least important motivators for hunters. Of the challenges we identify, communication problems, such as unresponsiveness and disputes, are the most substantial. We present recommendations to make the bug-bounty ecosystem accommodating to more bug hunters and ultimately increase participation in an underutilized market.


title: Resource Theory of Imaginarity: New Distributed Scenarios

abstract: The resource theory of imaginarity studies the operational value of imaginary parts in quantum states, operations, and measurements. Here we introduce and study the distillation and conversion of imaginarity in distributed scenario. This arises naturally in bipartite systems where both parties work together to generate the maximum possible imaginarity on one of the subsystems. We give exact solutions to this problem for general qubit states and pure states of arbitrary dimension. We present a scenario that demonstrates the operational advantage of imaginarity: the discrimination of quantum channels without the aid of an ancillary system. We then link this scenario to LOCC discrimination of bipartite states. We experimentally demonstrate the relevant assisted distillation protocol, and show the usefulness of imaginarity in the aforementioned two tasks.


title: Predictive World Models from Real-World Partial Observations

abstract: Cognitive scientists believe adaptable intelligent agents like humans perform reasoning through learned causal mental simulations of agents and environments. The problem of learning such simulations is called predictive world modeling. Recently, reinforcement learning (RL) agents leveraging world models have achieved SOTA performance in game environments. However, understanding how to apply the world modeling approach in complex real-world environments relevant to mobile robots remains an open question. In this paper, we present a framework for learning a probabilistic predictive world model for real-world road environments. We implement the model using a hierarchical VAE (HVAE) capable of predicting a diverse set of fully observed plausible worlds from accumulated sensor observations. While prior HVAE methods require complete states as ground truth for learning, we present a novel sequential training method to allow HVAEs to learn to predict complete states from partially observed states only. We experimentally demonstrate accurate spatial structure prediction of deterministic regions achieving 96.21 IoU, and close the gap to perfect prediction by 62% for stochastic regions using the best prediction. By extending HVAEs to cases where complete ground truth states do not exist, we facilitate continual learning of spatial prediction as a step towards realizing explainable and comprehensive predictive world models for real-world mobile robotics applications. Code is available at https://github.com/robin-karlsson0/predictive-world-models.


title: Analytical approximate solutions for scalarized AdS black holes

abstract: The spontaneous scalarization of Schwarzscild-AdS is investigated in the Einstein-scalar-Gauss--Bonnet (ESGB) theory. Firstly, we construct scalarized AdS black holes numerically. Secondly, making use of the homotopy analysis method (HAM), we obtain analytical approximate solutions for scalarized AdS black holes in the ESGB theory. It is found that scalarized AdS black holes constructed numerically are consistent with analytical approximate solutions in the whole space.


title: Phase-shifted Adversarial Training

abstract: Adversarial training has been considered an imperative component for safely deploying neural network-based applications to the real world. To achieve stronger robustness, existing methods primarily focus on how to generate strong attacks by increasing the number of update steps, regularizing the models with the smoothed loss function, and injecting the randomness into the attack. Instead, we analyze the behavior of adversarial training through the lens of response frequency. We empirically discover that adversarial training causes neural networks to have low convergence to high-frequency information, resulting in highly oscillated predictions near each data. To learn high-frequency contents efficiently and effectively, we first prove that a universal phenomenon of frequency principle, i.e., \textit{lower frequencies are learned first}, still holds in adversarial training. Based on that, we propose phase-shifted adversarial training (PhaseAT) in which the model learns high-frequency components by shifting these frequencies to the low-frequency range where the fast convergence occurs. For evaluations, we conduct the experiments on CIFAR-10 and ImageNet with the adaptive attack carefully designed for reliable evaluation. Comprehensive results show that PhaseAT significantly improves the convergence for high-frequency information. This results in improved adversarial robustness by enabling the model to have smoothed predictions near each data.


title: Distinct topological configurations of equatorial timelike circular orbit for spherically symmetric (hairy) black holes

abstract: Topology is a promising approach toward to the light ring in a generic black hole background, and equatorial timelike circular orbit in a stationary black hole background. In this paper, we consider the distinct topological configurations of the timelike circular orbits in static, spherically symmetric, and asymptotic flat black holes. By making use of the equation of motion of the massive particles, we construct a vector with its zero points exactly relating with the timelike circular orbits. Since each zero point of the vector can be endowed with a winding number, the topology of the timelike circular orbits is well established. Stable and unstable timelike circular orbits respectively have winding number +1 and -1. In particular, for given angular momentum, the topological number of the timelike circular orbits also vanishes whether they are rotating or not. Moreover, we apply the study to the Schwarzschild, scalarized Einstein-Maxwell, and dyonic black holes, which have three distinct topological configurations, representations of the radius and angular momentum relationship, with one or two pairs timelike circular orbits at most. It is shown that although the existence of scalar hair and quasi-topological term leads to richer topological configurations of the timelike circular orbits, they have no influence on the total topological number. These results indicate that the topological approach indeed provides us a novel way to understand the timelike circular orbits. Significantly, different topological configurations can share the same topology number, and hence belong to the same topological class. More information is expected to be disclosed when other different topological configurations are present.


title: Loss-difference-induced localization in a non-Hermitian honeycomb photonic lattice

abstract: Non-Hermitian systems with complex-valued energy spectra provide an extraordinary platform for manipulating unconventional dynamics of light. Here, we demonstrate the localization of light in an instantaneously reconfigurable non-Hermitian honeycomb photonic lattice that is established in a coherently-prepared atomic system. One set of the sublattices is optically modulated to introduce the absorptive difference between neighboring lattice sites, where the Dirac points in reciprocal space are extended into dispersionless local flat bands. When these local flat bands are broad enough due to larger loss difference, the incident beam is effectively localized at one set of the lattices with weaker absorption, namely, the commonly seen power exchange between adjacent channels in photonic lattices is effectively prohibited. The current work unlocks a new capability from non-Hermitian two-dimensional photonic lattices and provides an alternative route for engineering tunable local flat bands in photonic structures.


title: Language Cognition and Language Computation -- Human and Machine Language Understanding

abstract: Language understanding is a key scientific issue in the fields of cognitive and computer science. However, the two disciplines differ substantially in the specific research questions. Cognitive science focuses on analyzing the specific mechanism of the brain and investigating the brain's response to language; few studies have examined the brain's language system as a whole. By contrast, computer scientists focus on the efficiency of practical applications when choosing research questions but may ignore the most essential laws of language. Given these differences, can a combination of the disciplines offer new insights for building intelligent language models and studying language cognitive mechanisms? In the following text, we first review the research questions, history, and methods of language understanding in cognitive and computer science, focusing on the current progress and challenges. We then compare and contrast the research of language understanding in cognitive and computer sciences. Finally, we review existing work that combines insights from language cognition and language computation and offer prospects for future development trends.


title: Hardness of Ruling Out Short Proofs of Kolmogorov Randomness

abstract: A meta-complexity assumption, Feasible Chaitin Incompleteness (FCI), asserts the hardness of ruling out length $t$ proofs that string $x$ is Kolmogorov random (e.g. $x{\in}R$), by analogy to Chaitin's result that proving $x{\in}R$ is typically impossible. By assertion, efficiently ruling out short proofs requires, impossibly, ruling out any proof. FCI has strong implications: (i) randomly chosen $x$ typically yields tautologies hard with high probability for any given proof system, densely witnessing its nonoptimality; (ii) average-case impossibility of proving $x{\in}R$ implies average-case hardness of proving tautologies and Feige's hypothesis; and (iii) a natural language is $\textbf{NP}$-intermediate -- the sparse complement of "$x{\in}R$ lacks a length $t$ proof" (where $R$'s complement is sparse) -- and has $\textbf{P/poly}$ circuits despite not being in $\textbf{P}$. FCI and its variants powerfully assert: (i) noncomputability facts translate to hardness conjectures; (ii) numerous open complexity questions have the expected answers (e.g. non-collapse of $\textbf{PH}$), so one overarching conjecture subsumes many questions; and (iii) an implicit mapping between certain unprovable and hard-to-prove sentences is an isomorphism. Further research could relate FCI to other open questions and hardness hypotheses; consider whether $R$ frustrates conditional program logic, implying FCI; and consider whether an extended isomorphism maps any true unprovable sentence to hard-to-prove sentences.


title: On the Structural Generalization in Text-to-SQL

abstract: Exploring the generalization of a text-to-SQL parser is essential for a system to automatically adapt the real-world databases. Previous works provided investigations focusing on lexical diversity, including the influence of the synonym and perturbations in both natural language questions and databases. However, research on the structure variety of database schema~(DS) is deficient. Specifically, confronted with the same input question, the target SQL is probably represented in different ways when the DS comes to a different structure. In this work, we provide in-deep discussions about the structural generalization of text-to-SQL tasks. We observe that current datasets are too templated to study structural generalization. To collect eligible test data, we propose a framework to generate novel text-to-SQL data via automatic and synchronous (DS, SQL) pair altering. In the experiments, significant performance reduction when evaluating well-trained text-to-SQL models on the synthetic samples demonstrates the limitation of current research regarding structural generalization. According to comprehensive analysis, we suggest the practical reason is the overfitting of (NL, SQL) patterns.


title: Self-Attention Amortized Distributional Projection Optimization for Sliced Wasserstein Point-Cloud Reconstruction

abstract: Max sliced Wasserstein (Max-SW) distance has been widely known as a solution for less discriminative projections of sliced Wasserstein (SW) distance. In applications that have various independent pairs of probability measures, amortized projection optimization is utilized to predict the ``max" projecting directions given two input measures instead of using projected gradient ascent multiple times. Despite being efficient, Max-SW and its amortized version cannot guarantee metricity property due to the sub-optimality of the projected gradient ascent and the amortization gap. Therefore, we propose to replace Max-SW with distributional sliced Wasserstein distance with von Mises-Fisher (vMF) projecting distribution (v-DSW). Since v-DSW is a metric with any non-degenerate vMF distribution, its amortized version can guarantee the metricity when performing amortization. Furthermore, current amortized models are not permutation invariant and symmetric. To address the issue, we design amortized models based on self-attention architecture. In particular, we adopt efficient self-attention architectures to make the computation linear in the number of supports. With the two improvements, we derive self-attention amortized distributional projection optimization and show its appealing performance in point-cloud reconstruction and its downstream applications.


title: A Programming Model for GPU Load Balancing

abstract: We propose a GPU fine-grained load-balancing abstraction that decouples load balancing from work processing and aims to support both static and dynamic schedules with a programmable interface to implement new load-balancing schedules. Prior to our work, the only way to unleash the GPU's potential on irregular problems has been to workload-balance through application-specific, tightly coupled load-balancing techniques. With our open-source framework for load-balancing, we hope to improve programmers' productivity when developing irregular-parallel algorithms on the GPU, and also improve the overall performance characteristics for such applications by allowing a quick path to experimentation with a variety of existing load-balancing techniques. Consequently, we also hope that by separating the concerns of load-balancing from work processing within our abstraction, managing and extending existing code to future architectures becomes easier.


title: PINN for Dynamical Partial Differential Equations is Not Training Deeper Networks Rather Learning Advection and Time Variance

abstract: The concepts and techniques of physics-informed neural networks (PINNs) is studied and limitations are identified to make it efficient to approximate dynamical equations. Potential working research domains are explored for increasing the robustness of this technique for the solvability of partial differential equations. It is identified that PINNs potentially fails to stronger advection and longer time duration. Also, optimization function and constraint posing needs to be smarter. Even a shallow network is good for a lot of problems while powerful deeper network fails. Reservoir computing based recurrent neural network architecture is recommended to solve dynamical problems.


title: LiteLSTM Architecture Based on Weights Sharing for Recurrent Neural Networks

abstract: Long short-term memory (LSTM) is one of the robust recurrent neural network architectures for learning sequential data. However, it requires considerable computational power to learn and implement both software and hardware aspects. This paper proposed a novel LiteLSTM architecture based on reducing the LSTM computation components via the weights sharing concept to reduce the overall architecture computation cost and maintain the architecture performance. The proposed LiteLSTM can be significant for processing large data where time-consuming is crucial while hardware resources are limited, such as the security of IoT devices and medical data processing. The proposed model was evaluated and tested empirically on three different datasets from the computer vision, cybersecurity, speech emotion recognition domains. The proposed LiteLSTM has comparable accuracy to the other state-of-the-art recurrent architecture while using a smaller computation budget.


title: 1st Place Solution for ECCV 2022 OOD-CV Challenge Image Classification Track

abstract: OOD-CV challenge is an out-of-distribution generalization task. In this challenge, our core solution can be summarized as that Noisy Label Learning Is A Strong Test-Time Domain Adaptation Optimizer. Briefly speaking, our main pipeline can be divided into two stages, a pre-training stage for domain generalization and a test-time training stage for domain adaptation. We only exploit labeled source data in the pre-training stage and only exploit unlabeled target data in the test-time training stage. In the pre-training stage, we propose a simple yet effective Mask-Level Copy-Paste data augmentation strategy to enhance out-of-distribution generalization ability so as to resist shape, pose, context, texture, occlusion, and weather domain shifts in this challenge. In the test-time training stage, we use the pre-trained model to assign noisy label for the unlabeled target data, and propose a Label-Periodically-Updated DivideMix method for noisy label learning. After integrating Test-Time Augmentation and Model Ensemble strategies, our solution ranks the first place on the Image Classification Leaderboard of the OOD-CV Challenge. Code will be released in https://github.com/hikvision-research/OOD-CV.


title: 1st Place Solution for ECCV 2022 OOD-CV Challenge Object Detection Track

abstract: OOD-CV challenge is an out-of-distribution generalization task. To solve this problem in object detection track, we propose a simple yet effective Generalize-then-Adapt (G&A) framework, which is composed of a two-stage domain generalization part and a one-stage domain adaptation part. The domain generalization part is implemented by a Supervised Model Pretraining stage using source data for model warm-up and a Weakly Semi-Supervised Model Pretraining stage using both source data with box-level label and auxiliary data (ImageNet-1K) with image-level label for performance boosting. The domain adaptation part is implemented as a Source-Free Domain Adaptation paradigm, which only uses the pre-trained model and the unlabeled target data to further optimize in a self-supervised training manner. The proposed G&A framework help us achieve the first place on the object detection leaderboard of the OOD-CV challenge. Code will be released in https://github.com/hikvision-research/OOD-CV.


title: Faithful tropicalization and Skeleton of $\overline{M}_{0,n}$

abstract: We propose a comparison between the Berkovich skeleton of Berkovich analytification of $(\overline{\textsf{M}}_{0,n},{\overline{\textsf{M}}_{0,n} \setminus \textsf{M}_{0,n}})$ and faithful tropicalization of $\textsf{M}_{0,n}$ over a complete discrete valued field. In particular, we proved the two combinatorial structures are the same in terms of valuation in $\overline{\textsf{M}}^{\textsf{an}}_{0,n}$.


title: Coloured and Dependent Planar Matchings of Random Bipartite Graphs

abstract: In this paper, we study two problems related to planar matchings in random bipartite graphs. First, we colour each edge of the complete bipartite graph $K_{n,n}$ uniformly randomly from amongst ${r}$ colours and show that if ${r}$ grows linearly with ${n}$ then the maximum rainbow matching is a non-trivial fraction of ${r}$ with high probability, i.e. with probability converging to one as ${n \rightarrow \infty}$ Next we consider planar matchings in a dependent setting where each vertex is forced to choose exactly one neighbour from amongst all possible choices. We obtain estimates for the largest size of a planar matching and also discuss the implication of our results to longest increasing subsequences in enlarged random permutations.


title: Adaptive Context Selection for Polyp Segmentation

abstract: Accurate polyp segmentation is of great significance for the diagnosis and treatment of colorectal cancer. However, it has always been very challenging due to the diverse shape and size of polyp. In recent years, state-of-the-art methods have achieved significant breakthroughs in this task with the help of deep convolutional neural networks. However, few algorithms explicitly consider the impact of the size and shape of the polyp and the complex spatial context on the segmentation performance, which results in the algorithms still being powerless for complex samples. In fact, segmentation of polyps of different sizes relies on different local and global contextual information for regional contrast reasoning. To tackle these issues, we propose an adaptive context selection based encoder-decoder framework which is composed of Local Context Attention (LCA) module, Global Context Module (GCM) and Adaptive Selection Module (ASM). Specifically, LCA modules deliver local context features from encoder layers to decoder layers, enhancing the attention to the hard region which is determined by the prediction map of previous layer. GCM aims to further explore the global context features and send to the decoder layers. ASM is used for adaptive selection and aggregation of context features through channel-wise attention. Our proposed approach is evaluated on the EndoScene and Kvasir-SEG Datasets, and shows outstanding performance compared with other state-of-the-art methods. The code is available at https://github.com/ReaFly/ACSNet.


title: Minimum Weight Random Graphs with Edge Constraints

abstract: In this paper, we study two examples of minimum weight random graphs with edge constraints. First we consider the complete graph on ${n}$ vertices equipped with uniformly heavy edge weights and use iteration methods to obtain deviation estimates for the minimum weight of subtrees with a given number of edges. Next we analyze edge constrained minimum weight paths in the integer lattice ${\mathbb{Z}^d}$ and employ martingale difference techniques to describe the behaviour of the scaled minimum weight in terms of the edge constraint.


title: Anisotropic Enhancement of Lower Critical Field in Ultraclean Crystals of Spin-Triplet Superconductor UTe2

abstract: The paramagnetic spin-triplet superconductor UTe$_2$ has attracted significant attention because of its exotic superconducting properties including an extremely high upper critical field and possible chiral superconducting states. Recently, ultraclean single crystals of UTe$_2$ have become available, and thus measurements on these crystals are crucial to elucidate the intrinsic superconducting properties. Here, we report the thermodynamic critical field $H_{\rm c}$, the lower critical field $H_{\rm c1}$, and the upper critical field $H_{\rm c2}$ at low fields of these high-quality single crystals. From the comparison of the anisotropies in $H_{\rm c1}$ and $H_{\rm c2}$, we find that the experimental $H_{\rm c1}$ values with the magnetic field along $b$- and $c$-axes are anomalously enhanced, showing unusual low-temperature upturns. We propose an effect of the strong Ising-like ferromagnetic fluctuations on the vortex line energy as the origin of the anisotropic enhancement of $H_{\rm c1}$.


title: Diffusion-based Data Augmentation for Skin Disease Classification: Impact Across Original Medical Datasets to Fully Synthetic Images

abstract: Despite continued advancement in recent years, deep neural networks still rely on large amounts of training data to avoid overfitting. However, labeled training data for real-world applications such as healthcare is limited and difficult to access given longstanding privacy, and strict data sharing policies. By manipulating image datasets in the pixel or feature space, existing data augmentation techniques represent one of the effective ways to improve the quantity and diversity of training data. Here, we look to advance augmentation techniques by building upon the emerging success of text-to-image diffusion probabilistic models in augmenting the training samples of our macroscopic skin disease dataset. We do so by enabling fine-grained control of the image generation process via input text prompts. We demonstrate that this generative data augmentation approach successfully maintains a similar classification accuracy of the visual classifier even when trained on a fully synthetic skin disease dataset. Similar to recent applications of generative models, our study suggests that diffusion models are indeed effective in generating high-quality skin images that do not sacrifice the classifier performance, and can improve the augmentation of training datasets after curation.


title: Nucleation of Al Nanocrystals in Solute-Substituted Al Metallic Glasses I: Structural characterization

abstract: Primary crystallization in high Al-content metallic glasses is driven by nanometer-diameter regions with internal structure similar to fcc Al. Comparison of fluctuation electron microscopy (FEM) data to FEM simulations of fcc Al clusters dispersed in a dense-random packed matrix is used to extract the diameter and volume fraction of the ordered regions in a Al88Y7Fe5 base glass and in glasses with 1 at.% Cu substituted for Y or Al. The size and density of nanocrystals were measured as a function of isothermal annealing time for the same alloys. The volume fraction of crystalline material grows under isothermal annealing, so the phase transformation is not purely grain coarsening, but the crystalline volume fraction is lower than the volume fraction of ordered regions in the as-quenched samples, so not all of the ordered regions act as nuclei. Changes in diameter and volume fraction of the ordered regions with alloying are correlated with changes in the crystallization temperature, nucleation rate, and nanocrystal density. No evidence for phase separation is observed, and FEM simulations from a molecular dynamics quenched structural model of similar composition do not show the features observed in experiment.


title: A Generalized Estimating Equation Approach to Network Regression

abstract: Regression models applied to network data where node attributes are the dependent variables poses a methodological challenge. As has been well studied, naive regression neither properly accounts for community structure, nor does it account for the dependent variable acting as both model outcome and covariate. To address this methodological gap, we propose a network regression model motivated by the important observation that controlling for community structure can, when a network is modular, significantly account for meaningful correlation between observations induced by network connections. We propose a generalized estimating equation (GEE) approach to learn model parameters based on clusters defined through any single-membership community detection algorithm applied to the observed network. We provide a necessary condition on the network size and edge formation probabilities to establish the asymptotic normality of the model parameters under the assumption that the graph structure is a stochastic block model. We evaluate the performance of our approach through simulations and apply it to estimate the joint impact of baseline covariates and network effects on COVID-19 incidence rate among countries connected by a network of commercial airline traffic. We find that during the beginning of the pandemic the network effect has some influence, the percentage of urban population has more influence on the incidence rate compared to the network effect after the travel ban was in effect.


title: DEA-Net: Single image dehazing based on detail-enhanced convolution and content-guided attention

abstract: Single image dehazing is a challenging ill-posed problem which estimates latent haze-free images from observed hazy images. Some existing deep learning based methods are devoted to improving the model performance via increasing the depth or width of convolution. The learning ability of convolutional neural network (CNN) structure is still under-explored. In this paper, a detail-enhanced attention block (DEAB) consisting of the detail-enhanced convolution (DEConv) and the content-guided attention (CGA) is proposed to boost the feature learning for improving the dehazing performance. Specifically, the DEConv integrates prior information into normal convolution layer to enhance the representation and generalization capacity. Then by using the re-parameterization technique, DEConv is equivalently converted into a vanilla convolution with NO extra parameters and computational cost. By assigning unique spatial importance map (SIM) to every channel, CGA can attend more useful information encoded in features. In addition, a CGA-based mixup fusion scheme is presented to effectively fuse the features and aid the gradient flow. By combining above mentioned components, we propose our detail-enhanced attention network (DEA-Net) for recovering high-quality haze-free images. Extensive experimental results demonstrate the effectiveness of our DEA-Net, outperforming the state-of-the-art (SOTA) methods by boosting the PSNR index over 41 dB with only 3.653 M parameters. The source code of our DEA-Net will be made available at https://github.com/cecret3350/DEA-Net.


title: RF Injection Locking of THz Metasurface Quantum-Cascade VECSEL

abstract: RF injection locking and spectral broadening of a terahertz (THz) quantum-cascade vertical-external-cavity surface-emitting laser (QC-VECSEL) is demonstrated. An intra-cryostat VECSEL focusing cavity design is used to enable continuous-wave lasing with a cavity length over 30 mm which corresponds to a round-trip frequency near 5 GHz. Strong RF current modulation is injected to the QC-metasurface electrical bias to pull and lock the round-trip frequency. The injection locking range at various RF injection powers is recorded and compared with the injection locking theory. Moreover, the lasing spectrum broadens from 14 GHz in free-running mode to a maximum spectral width around 100 GHz with 20 dBm of injected RF power. This experimental setup is suitable for further exploration of active mode-locking and picosecond pulse generation in THz QC-VECSELs.


title: The Path from the Chinese and Japanese Observations of Supernova 1181 AD, to a Type Iax Supernova, to the Merger of CO and ONe White Dwarfs

abstract: In 1181 AD, Chinese and Japanese observers reported an unmoving bright `Guest Star' in the constellation Chuanshe, visible for 185 days. In 2013, D. Patchick discovered what turned out to be a unique nebula surrounding a unique star, with the structure named `Pa 30', while subsequent workers made connections to mergers of white dwarfs, to the supernova subclass of low-luminosity Type Iax, and to the 1181 transient. Here, I provide a wide range of new observational evidence: First, detailed analysis of the original Chinese and Japanese reports places the `Guest Star' of 1181 into a small region with the only interesting source being Pa 30. Second, the ancient records confidently place the peak magnitude as 0.0$>$$V_{\rm peak}$$>$$-$1.4, and hence peak absolute magnitude $-$14.5$>$$M_{{\rm V,peak}}$$>$$-$16.0 mag. Third, the Pa 30 central star is fading from $B$=14.9 in 1889, to $B$=16.20 in 1950, to $B$=16.58 in 2022. Fourth, recent light curves show typical variability with full-amplitude of 0.24 mag on time-scales of one day and longer, critically with no coherent modulations for periods from 0.00046--10 days to strict limits. Fifth, the spectral energy distribution from the far-infrared to the ultraviolet is a nearly-perfect power-law with $F_{\nu}\propto\nu^{0.99\pm0.07}$, observed luminosity 128$\pm$24 L$_{\odot}$, and absolute magnitude $M_{\rm V}$=$+$1.07. I collect my new evidences with literature results to make a confident case to connect the East-Asian observations to a supernova, then to Pa 30, then to a low-luminosity Type Iax SN, then to the only possible explosion mechanism as a merger between CO and ONe white dwarfs.


title: Redundancy of Codes with Graph Constraints

abstract: In this paper, we study the redundancy of linear codes with graph constraints. First we consider linear parity check codes based on bipartite graphs with diversity and with generalized graph constraints. We describe sufficient conditions on the constraint probabilities and use the probabilistic method to obtain linear codes that achieve the Gilbert-Varshamov redundancy bound in addition to satisfying the constraints and the diversity index. In the second part we consider a generalization of graph capacity which we call as the fractional graph capacity and use the probabilistic method to determine bounds on the fractional capacity for arbitrary graphs. Specifically, we establish an upper bound in terms of the full graph capacity and a lower bound in terms of the average and maximum vertex degree of the graph.


title: Discovery of an Exceptional Optical Nebulosity in the Suspected Galactic SN Iax Remnant Pa 30 Linked to the Historical Guest Star of 1181 CE

abstract: A newly recognized young Galactic SN remnant, Pa 30 (G123.1+4.6), centered on a hot central star with a ~16,000 km/s wind velocity has recently been proposed to be the result of a double-degenerate merger leading to a SN Iax event associated with the guest star of 1181 CE. Here we present deep optical [S II] 6716,6731 images of Pa 30 which reveal an extraordinary and highly structured nebula 170" in diameter with dozens of long (5" - 20") radially aligned filaments with a convergence point near the hot central star. Optical spectra of filaments indicate a peak expansion velocity ~1100 km/s with electron densities of <100 to 700 cm^-3, and a thick shell-like structure resembling its appearance in 22 micron WISE images. No H-alpha emission was seen (I[6716/H-alpha] >5), with the only other line emission detected being faint [Ar III] 7136 suggesting a S, Ar-rich but H-poor remnant. The nebula's angular size, estimated 2.3 kpc distance, and 1100 km/s expansion velocity are consistent with an explosion date around 1181 CE. The remnant's unusual appearance may be due to the photoionization of wind-driven ejecta due to clump-wind interactions caused by the central star's high-luminosity wind.


title: Long-distance migration with minimal energy consumption in a thermal turbulent environment

abstract: We adopt the reinforcement learning algorithm to train the self-propelling agent migrating long-distance in a thermal turbulent environment. We choose the Rayleigh-B\'enard turbulent convection cell with an aspect ratio ($\Gamma$, which is defined as the ratio between cell length and cell height) of 2 as the training environment. Our results showed that, compared to a naive agent that moves straight from the origin to the destination, the smart agent can learn to utilize the carrier flow currents to save propelling energy. We then apply the optimal policy obtained from the $\Gamma=2$ cell and test the smart agent migrating in convection cells with $\Gamma$ up to 32. In a larger $\Gamma$ cell, the dominant flow modes of horizontally stacked rolls are less stable, and the energy contained in higher-order flow modes increases. We found that the optimized policy can be successfully extended to convection cells with a larger $\Gamma$. In addition, the ratio of propelling energy consumed by the smart agent to that of the naive agent decreases with the increase of $\Gamma$, indicating more propelling energy can be saved by the smart agent in a larger $\Gamma$ cell. We also evaluate the optimized policy when the agents are being released from the randomly chosen origin, which aims to test the robustness of the learning framework, and possible solutions to improve the success rate are suggested. This work has implications for long-distance migration problems, such as unmanned aerial vehicles patrolling in a turbulent convective environment, where planning energy-efficient trajectories can be beneficial to increase their endurance.


title: Deformation measurement of a soil mixing retaining wall using terrestrial laser scanning

abstract: Retaining walls are often built to prevent excessive lateral movements of the ground surrounding an excavation site. During an excavation, failure of retaining walls could cause catastrophic accidents and hence their lateral deformations are monitored regularly. Laser scanning can rapidly acquire the spatial data of a relatively large area at fine spatial resolutions, which is ideal for monitoring retaining walls' deformations. This paper attempts to apply laser scanning to measurements of the lateral deformations of a soil mixing retaining wall at an ongoing excavation site. Reference measurements by total station and inclinometer were also conducted to verify those from the laser scanning. The deformations derived using laser scanning data were consistent with the reference measurements at the top part of the retaining wall (i.e., mainly the ring beam of the wall). This research also shows that the multi-scale-model-to-model method was the most accurate deformation estimation method on the research data.


title: A Two-limb Explanation for the Optical-to-infrared Transmission Spectrum of the Hot Jupiter HAT-P-32Ab

abstract: We present a new optical transmission spectrum of the hot Jupiter HAT-P-32Ab acquired with the Carnegie Observatories Spectrograph and Multiobject Imaging Camera (COSMIC) on the Palomar 200 inch Hale Telescope (P200). The P200/COSMIC transmission spectrum, covering a wavelength range of 3990--9390 \AA, is composed of 25 spectrophotometric bins with widths ranging from 200 to 400 \AA and consistent with previous transit measurements obtained in the common wavelength range. We derive a combined optical transmission spectrum based on measurements from five independent instruments, which, along with the 1.1--1.7 $\mu$m spectrum acquired by the Hubble Space Telescope and two Spitzer measurements, exhibits an enhanced scattering slope blueward of a relatively flat optical continuum, a water absorption feature at 1.4 $\mu$m, and a carbon dioxide feature at 4.4 $\mu$m. We perform Bayesian spectral retrieval analyses on the 0.3--5.1 $\mu$m transmission spectrum and find that it can be well explained by a two-limb approximation of $134^{+45}_{-33}\times$ solar metallicity, with a strongly hazy morning limb of $1134^{+232}_{-194}$ K and a haze-free evening limb of $1516^{+33}_{-44}$~K. This makes HAT-P-32Ab a promising target for James Webb Space Telescope to look for asymmetric signatures directly in the light curves.


title: On effective log Iitaka fibrations and existence of complements

abstract: We study the relationship between Iitaka fibrations and the conjecture on the existence of complements, assuming the good minimal model conjecture. In one direction, we show that the conjecture on the existence of complements implies the effective log Iitaka fibration conjecture. As a consequence, the effective log Iitaka fibration conjecture holds in dimension $3$. In the other direction, for any Calabi-Yau type variety $X$ such that $-K_X$ is nef, we show that $X$ has an $n$-complement for some universal constant $n$ depending only on the dimension of $X$ and two natural invariants of a general fiber of an Iitaka fibration of $-K_X$. We also formulate the decomposable Iitaka fibration conjecture, a variation of the effective log Iitaka fibration conjecture which is closely related to the structure of ample models of pairs with non-rational coefficients, and study its relationship with the forestated conjectures.


title: Multi-Constraint Molecular Generation using Sparsely Labelled Training Data for Localized High-Concentration Electrolyte Diluent Screening

abstract: Recently, machine learning methods have been used to propose molecules with desired properties, which is especially useful for exploring large chemical spaces efficiently. However, these methods rely on fully labelled training data, and are not practical in situations where molecules with multiple property constraints are required. There is often insufficient training data for all those properties from publicly available databases, especially when ab-initio simulation or experimental property data is also desired for training the conditional molecular generative model. In this work, we show how to modify a semi-supervised variational auto-encoder (SSVAE) model which only works with fully labelled and fully unlabelled molecular property training data into the ConGen model, which also works on training data that have sparsely populated labels. We evaluate ConGen's performance in generating molecules with multiple constraints when trained on a dataset combined from multiple publicly available molecule property databases, and demonstrate an example application of building the virtual chemical space for potential Lithium-ion battery localized high-concentration electrolyte (LHCE) diluents.


title: Machine-learning Analysis of Opioid Use Disorder Informed by MOR, DOR, KOR, NOR and ZOR-Based Interactome Networks

abstract: Opioid use disorder (OUD) continuously poses major public health challenges and social implications worldwide with dramatic rise of opioid dependence leading to potential abuse. Despite that a few pharmacological agents have been approved for OUD treatment, the efficacy of said agents for OUD requires further improvement in order to provide safer and more effective pharmacological and psychosocial treatments. Preferable therapeutic treatments of OUD rely on the advances in understanding the neurobiological mechanism of opioid dependence. Proteins including mu, delta, kappa, nociceptin, and zeta opioid receptors are the direct targets of opioids. Each receptor has a large protein-protein interaction (PPI) network, that behaves differently when subjected to various treatments, thus increasing the complexity in the drug development process for an effective opioid addiction treatment. The report below analyzes the work by presenting a PPI-network informed machine-learning study of OUD. We have examined more than 500 proteins in the five opioid receptor networks and subsequently collected 74 inhibitor datasets. Machine learning models were constructed by pairing gradient boosting decision tree (GBDT) algorithm with two advanced natural language processing (NLP)-based molecular fingerprints. With these models, we systematically carried out evaluations of screening and repurposing potential of drug candidates for four opioid receptors. In addition, absorption, distribution, metabolism, excretion, and toxicity (ADMET) properties were also considered in the screening of potential drug candidates. Our study can be a valuable and promising tool of pharmacological development for OUD treatments.


title: Analytical Approximations for Generalized Landau-Zener Transitions in Multi-level Non-Hermitian Systems

abstract: We study the dynamics of non-adiabatic transitions in non-Hermitian multi-level parabolic models where the separations of the diabatic energies are quadratic function of time. The model Hamiltonian has been used to describe the non-Hermitian dynamics of two pairs of coupled cavities. In the absence of the coupling between any two pairs of cavities, the wave amplitudes within each subsystem are described by the tri-confluent Heun functions. When all the couplings between the cavities are present, we reduce the dynamics into a set of two coupled tri-confluent Heun equations, from which we derive analytical approximations for the wave amplitudes at different physical limits.


title: Consensus in the Unknown-Participation Message-Adversary Model

abstract: We propose a new distributed-computing model, inspired by permissionless distributed systems such as Bitcoin and Ethereum, that allows studying permissionless consensus in a mathematically regular setting. Like in the sleepy model of Pass and Shi, we consider a synchronous, round-by-round message-passing system in which the set of online processors changes each round. Unlike the sleepy model, the set of processors may be infinite. Moreover, processors never fail; instead, an adversary can temporarily or permanently impersonate some processors. Finally, processors have access to a strong form of message-authentication that authenticates not only the sender of a message but also the round in which the message was sent. Assuming that, each round, the adversary impersonates less than 1/2 of the online processors, we present two consensus algorithms. The first ensures deterministic safety and constant latency in expectation, assuming a probabilistic leader-election oracle. The second ensures deterministic safety and deterministic liveness assuming irrevocable impersonation and eventually-stabilizing participation. The model is unrealistic in full generality. However, if we assume finitely many processes and that the set of faulty processes remains constant, the model coincides with a practically-motivated model: the static version of the sleepy model.


title: Quantum chaos in interacting Bose-Bose mixtures

abstract: The appearance of chaotic quantum dynamics significantly depends on the symmetry properties of the system, and in cold atomic systems many of these can be experimentally controlled. In this work, we systematically study the emergence of quantum chaos in a minimal system describing one-dimensional harmonically trapped Bose-Bose mixtures by tuning the particle-particle interactions. Using an advanced exact diagonalization scheme, we examine the transition from integrability to chaos when the inter-component interaction changes from weak to strong. Our study is based on the analysis of the level spacing distribution and the distribution of the matrix elements of observables in terms of the eigenstate thermalization hypothesis and their dynamics. We show that one can obtain strong signatures of chaos by increasing the inter-component interaction strength and breaking the symmetry of intra-component interactions.


title: Data-centric AI: Perspectives and Challenges

abstract: The role of data in building AI systems has recently been significantly magnified by the emerging concept of data-centric AI (DCAI), which advocates a fundamental shift from model advancements to ensuring data quality and reliability. Although our community has continuously invested efforts into enhancing data in different aspects, they are often isolated initiatives on specific tasks. To facilitate the collective initiative in our community and push forward DCAI, we draw a big picture and bring together three general missions: training data development, inference data development, and data maintenance. We provide a top-level discussion on representative DCAI tasks and share perspectives. Finally, we list open challenges. More resources are summarized at https://github.com/daochenzha/data-centric-AI


title: Solving the Wigner Equation for Chemically Relevant Scenarios: Dynamics in 2D

abstract: Signed Particle Monte Carlo (SPMC) approach has been used in the past to model steady-state and transient dynamics of the Wigner quasi-distribution for electrons in low dimensional semiconductors. Here we make a step towards high-dimensional quantum phase-space simulation in chemically relevant scenarios by improving the stability and memory demands of SPMC in 2D. We do so by using an unbiased propagator for SPMC to improve trajectory stability and by applying machine learning to reduce memory demands for storage and manipulation of the Wigner potential. We perform computational experiments on a 2D double-well toymodel of proton transfer and demonstrate stable pico-second-long trajectories that require only a modest computational effort.


title: On the Application of Non-Gaussian Noise in Stochastic Langevin Simulations

abstract: In light of recent advances in time-step independent stochastic integrators for Langevin equations, we revisit the considerations for using non-Gaussian distributions for the thermal noise term in discrete-time thermostats. We find that the desirable time-step invariance of the modern methods is rooted in the Gaussian noise, and that deviations from this distribution will distort the Boltzmann statistics arising from the fluctuation-dissipation balance of the integrators. We use the GJ stochastic Verlet methods as the focus of our investigation since these methods are the ones that contain the most accurate thermodynamic measures of existing methods. Within this set of methods we find that any distribution of applied noise, which satisfies the two first moments given by the fluctuation-dissipation theorem, will result in correct, time-step independent results that are generated by the first two moments of the system coordinates. However, if non-Gaussian noise is applied, undesired deviations in higher moments of the system coordinates will appear to the detriment of several important thermodynamic measures that depend especially on the fourth moments. The deviations, induced by non-Gaussian noise, become significant with the one-time-step velocity attenuation, thereby inhibiting the benefits of the methods. Thus, we conclude that the application of Gaussian noise is necessary for reliable thermodynamic results when using modern stochastic thermostats with large time steps.


title: Private estimation algorithms for stochastic block models and mixture models

abstract: We introduce general tools for designing efficient private estimation algorithms, in the high-dimensional settings, whose statistical guarantees almost match those of the best known non-private algorithms. To illustrate our techniques, we consider two problems: recovery of stochastic block models and learning mixtures of spherical Gaussians. For the former, we present the first efficient $(\epsilon, \delta)$-differentially private algorithm for both weak recovery and exact recovery. Previously known algorithms achieving comparable guarantees required quasi-polynomial time. For the latter, we design an $(\epsilon, \delta)$-differentially private algorithm that recovers the centers of the $k$-mixture when the minimum separation is at least $ O(k^{1/t}\sqrt{t})$. For all choices of $t$, this algorithm requires sample complexity $n\geq k^{O(1)}d^{O(t)}$ and time complexity $(nd)^{O(t)}$. Prior work required minimum separation at least $O(\sqrt{k})$ as well as an explicit upper bound on the Euclidean norm of the centers.


title: Cryogenic temperature deposition of high-performance CoFeB/MgO/CoFeB magnetic tunnel junctions on 300 mm wafers

abstract: We developed a cryogenic temperature deposition process for high-performance CoFeB/MgO/CoFeB magnetic tunnel junctions (MTJs) on 300 mm thermally oxidized silicon wafers. The effect of the deposition temperature of the CoFeB layers on the nanostructure, magnetic and magneto-transport properties of the MTJs were investigated in detail. When CoFeB was deposited at 100 K, the MTJs exhibited a perpendicular magnetic anisotropy (PMA) of 214 uJ/m2 and a voltage-controlled magnetic anisotropy (VCMA) coefficient of -45 fJ/Vm, corresponding to 1.4- and 1.7-fold enhancements in PMA and VCMA, respectively, compared to the case of room-temperature deposition of CoFeB. The improvement in the MTJ properties was not simply due to the morphology of the MTJ films. The interface-sensitive magneto-transport properties indicated that interfacial qualities such as intermixing and oxidation states at the MgO/CoFeB interfaces were improved by the cryogenic temperature deposition. Cryogenic-temperature sputtering deposition is expected to be a standard manufacturing process for next-generation magnetoresistive random-access memory.


title: A Network Science perspective of Graph Convolutional Networks: A survey

abstract: The mining and exploitation of graph structural information have been the focal points in the study of complex networks. Traditional structural measures in Network Science focus on the analysis and modelling of complex networks from the perspective of network structure, such as the centrality measures, the clustering coefficient, and motifs and graphlets, and they have become basic tools for studying and understanding graphs. In comparison, graph neural networks, especially graph convolutional networks (GCNs), are particularly effective at integrating node features into graph structures via neighbourhood aggregation and message passing, and have been shown to significantly improve the performances in a variety of learning tasks. These two classes of methods are, however, typically treated separately with limited references to each other. In this work, aiming to establish relationships between them, we provide a network science perspective of GCNs. Our novel taxonomy classifies GCNs from three structural information angles, i.e., the layer-wise message aggregation scope, the message content, and the overall learning scope. Moreover, as a prerequisite for reviewing GCNs via a network science perspective, we also summarise traditional structural measures and propose a new taxonomy for them. Finally and most importantly, we draw connections between traditional structural approaches and graph convolutional networks, and discuss potential directions for future research.


title: First-principles thermal equation of state of fcc iridium

abstract: The thermal equation of states for fcc iridium (Ir) is obtained from first-principles molecular dynamics up to 3000 K and 540 GPa. The equation of state (EoS) is globally fitted to a simplified free energy model and various parameters are derived. The theoretical principal Hugoniot is compared with shockwave experiments, where discrepancy suggests formation of new Ir phases. A few representative EoS parameters, such as bulk modulus $K_T$, thermal expansivity $\alpha$, Gr\"uneisen parameter $\gamma$, and constant pressure capacity $C_P$, Debye temperature, $\Theta_D$ are computed to compare with experimental data


title: Probing lens-induced gravitational-wave birefringence as a test of general relativity

abstract: Theories beyond general relativity (GR) modify the propagation of gravitational waves (GWs). In some, inhomogeneities (aka. gravitational lenses) allow interactions between the metric and additional fields to cause lens-induced birefringence (LIB): a different speed of the two linear GW polarisations ($+$ and $\times$). Inhomogeneities then act as non-isotropic crystals, splitting the GW signal into two components whose relative time delay depends on the theory and lens parameters. Here we study the observational prospects for GW scrambling, i.e when the time delay between both GW polarisations is smaller than the signal's duration and the waveform recorded by a detector is distorted. We analyze the latest LIGO-Virgo-KAGRA catalog, GWTC-3, and find no conclusive evidence for LIB. The highest log Bayes factor that we find in favour of LIB is $3.21$ for GW$190521$, a particularly loud but short event. However, when accounting for false alarms due to (Gaussian) noise fluctuations, this evidence is below 1-$\sigma$. The tightest constraint on the time delay is $<0.51$ ms (90% C.L.) from GW$200311\_115853$. From the non-observation of GW scrambling, we constrain the optical depth for LIB, accounting for the chance of randomly distributed lenses (eg. galaxies) along the line of sight. Our LIB constraints on a (quartic) scalar-tensor Horndeski theory are more stringent than solar system tests for a wide parameter range and comparable to GW170817 in some limits. Interpreting GW190521 as an AGN binary (i.e. taking an AGN flare as a counterpart) allows even more stringent constraints. Our results demonstrate the potential and high sensitivity achievable by tests of GR, based on GW lensing.


title: 5-D thermal field theory, Einstein field equations and spontaneous symmetry breaking

abstract: It has been shown previously, that the spatial thermal variation of a thermal medium can be recast as a variation in the Euclidean metric. It is now extended to temporal variations in temperature, for a non-relativistic thermal bath, which remains in local thermal equilibrium. This is achieved by examining the thermal field theory in a five-dimensional space-time-temperature. The bulk thermodynamic quantity, namely the energy density, is calculated for a neutral scalar field with a time-dependent Hamiltonian. Furthermore, the concept of recasting thermal variations as a variation in the metric is extended to thermal systems in a gravitational field. The Einstein field equations, in the 5-D space-time-temperature, is determined. It is shown that the resulting Ricci scalar can then lead to spontaneous symmetry breaking, leading to the Higgs mechanism. In essence, the asymmetry in the distribution of temperature in space-time can translate to spontaneous symmetry breaking of particle fields, in a very strong gravitational field.

categories: hep-th cond-mat.other gr-qc hep-ph math-ph math.MP


title: Localized covariance estimation: A Bayesian perspective

abstract: A major problem in numerical weather prediction (NWP) is the estimation of high-dimensional covariance matrices from a small number of samples. Maximum likelihood estimators cannot provide reliable estimates when the overall dimension is much larger than the number of samples. Fortunately, NWP practitioners have found ingenious ways to boost the accuracy of their covariance estimators by leveraging the assumption that the correlations decay with spatial distance. In this work, Bayesian statistics is used to provide a new justification and analysis of the practical NWP covariance estimators. The Bayesian framework involves manipulating distributions over symmetric positive definite matrices, and it leads to two main findings: (i) the commonly used "hybrid estimator" for the covariance matrix has a naturally Bayesian interpretation; (ii) the very commonly used "Schur product estimator" is not Bayesian, but it can be studied and understood within the Bayesian framework. As practical implications, the Bayesian framework shows how to reduce the amount of tuning required for covariance estimation, and it suggests that efficient covariance estimation should be rooted in understanding and penalizing conditional correlations, rather than correlations.


title: Federated Transfer-Ordered-Personalized Learning for Driver Monitoring Application

abstract: Federated learning (FL) shines through in the internet of things (IoT) with its ability to realize collaborative learning and improve learning efficiency by sharing client model parameters trained on local data. Although FL has been successfully applied to various domains, including driver monitoring applications (DMAs) on the internet of vehicles (IoV), its usages still face some open issues, such as data and system heterogeneity, large-scale parallelism communication resources, malicious attacks, and data poisoning. This paper proposes a federated transfer-ordered-personalized learning (FedTOP) framework to address the above problems and test on two real-world datasets with and without system heterogeneity. The performance of the three extensions, transfer, ordered, and personalized, is compared by an ablation study and achieves 92.32% and 95.96% accuracy on the test clients of two datasets, respectively. Compared to the baseline, there is a 462% improvement in accuracy and a 37.46% reduction in communication resource consumption. The results demonstrate that the proposed FedTOP can be used as a highly accurate, streamlined, privacy-preserving, cybersecurity-oriented, and personalized framework for DMA.


title: An approximation to peak detection power using Gaussian random field theory

abstract: We study power approximation formulas for peak detection using Gaussian random field theory. The approximation, based on the expected number of local maxima above the threshold $u$, $\mathbb{E}[M_u]$, is proved to work well under three asymptotic scenarios: small domain, large threshold, and sharp signal. An adjusted version of $\mathbb{E}[M_u]$ is also proposed to improve accuracy when the expected number of local maxima $\mathbb{E}[M_{-\infty}]$ exceeds 1. Cheng and Schwartzman (2018) developed explicit formulas for $\mathbb{E}[M_u]$ of smooth isotropic Gaussian random fields with zero mean. In this paper, these formulas are extended to allow for rotational symmetric mean functions, so that they are suitable for power calculations. We also apply our formulas to 2D and 3D simulated datasets, and the 3D data is induced by a group analysis of fMRI data from the Human Connectome Project to measure performance in a realistic setting.


title: Discovery of the Tadpole Molecular Cloud near the Galactic Nucleus

abstract: In this paper, we report the discovery of an isolated, peculiar compact cloud with a steep velocity gradient at $2\farcm 6$ northwest of Sgr A*. This ``Tadpole'' molecular cloud is unique owing to its characteristic head-tail structure in the position-velocity space. By tracing the CO {\it J}=3--2 intensity peak in each velocity channel, we noticed that the kinematics of the Tadpole can be well reproduced by a Keplerian motion around a point-like object with a mass of $1\!\times\! 10^{5}\,M_{\odot}$. Changes in line intensity ratios along the orbit are consistent with the Keplerian orbit model. The spatial compactness of the Tadpole and absence of bright counterparts in other wavelengths indicate that the object could be an intermediate-mass black hole.


title: Optical response of Higgs mode in superconductors at clean limit: formulation through Eilenberger equation and Ginzburg-Landau Lagrangian

abstract: Both macroscopic Ginzburg-Landau Lagrangian and microscopic gauge-invariant kinetic equation suggest a finite Higgs-mode generation in the second-order optical response of superconductors at clean limit, whereas the previous derivations through the path-integral approach and Eilenberger equation within the Matsubara formalism failed to give such generation. The crucial treatment leading to this controversy lies at an artificial scheme that whether the external optical frequency is taken as continuous variable or bosonic Matsubara frequency to handle the gap dynamics within the Matsubara formalism. To resolve this issue, we derive the effective action of the superconducting gap near $T_c$ in the presence of the vector potential through the path-integral approach, to fill the long missing blank of the microscopic derivation of the Ginzburg-Landau Lagrangian in superconductors. It is shown that only by taking optical frequency as continuous variable within the Matsubara formalism, can one achieve the fundamental Ginzburg-Landau Lagrangian, and in particular, the finite Ginzburg-Landau kinetic term leads to a finite Higgs-mode generation at clean limit. To further eliminate the confusion of the Matsubara frequency through a separate framework, we apply the Eilenberger equation within the Keldysh formalism, which is totally irrelevant to the Matsubara space. By calculating the gap dynamics in the second-order response, it is analytically proved that the involved optical frequency is a continuous variable rather than bosonic Matsubara frequency, causing a finite Higgs-mode generation at clean limit.


title: Safety-Critical Traffic Control by Connected Automated Vehicles

abstract: Connected automated vehicles (CAVs) have shown great potential in improving traffic throughput and stability. Although various longitudinal control strategies have been developed for CAVs to achieve string stability in mixed-autonomy traffic systems, the potential impact of these controllers on safety has not yet been fully addressed. This paper proposes safety-critical traffic control (STC) by CAVs -- a strategy that allows a CAV to stabilize the traffic behind it, while maintaining safety relative to both the preceding vehicle and the following connected human-driven vehicles (HDVs). Specifically, we utilize control barrier functions (CBFs) to impart collision-free behavior with formal safety guarantees to the closed-loop system. The safety of both the CAV and HDVs is incorporated into the framework through a quadratic program-based controller, that minimizes deviation from a nominal stabilizing traffic controller subject to CBF-based safety constraints. Considering that some state information of the following HDVs may be unavailable to the CAV, we employ state observer-based CBFs for STC. Finally, we conduct extensive numerical simulations -- that include vehicle trajectories from real data -- to demonstrate the efficacy of the proposed approach in achieving string stable and, at the same time, provably safe traffic.


title: Near horizon approximation and beyond for a two-level atom falling into a Kerr-Newman black hole

abstract: In this work we investigate the phenomena of acceleration radiation for a two-level atom falling into the event horizon of a Kerr-Newman black hole. In https://link.aps.org/doi/10.1103/PhysRevD.104.065006 (Phys. Rev. D 104 (2021) 065006), it has been shown that conformal quantum mechanics has a connection to the generated Planck-like spectrum due to acceleration radiation. In this particular aspect, the near horizon approximation played a significant role. In https://link.aps.org/doi/10.1103/PhysRevD.106.025004 (Phys. Rev. D 106 (2022) 025004), we have used the beyond near horizon approximation to show that the excitation probability attains a Planck-like spectrum irrespective of the non-existence of an underlying conformal symmetry for a general class of static spherically symmetric black holes. In our analysis we have gone beyond the near horizon approximation for the rotating and charged case and even without the consideration of the conformal symmetry we observe a similar Planck-like spectrum. However, the coefficient of the spectrum is significantly different from the near horizon case. We have then considered a different scenario where a two-level atom emits multiple photons while freely falling into the event horizon of the Kerr-Newman black hole. It is observed that the Planck factor in the excitation probability is significantly small than that of the case of single-photon emission (for large number of simultaneously emitted photons from the two-level atom). Finally, we have computed the von-Neumann entropy which is also known as the horizon brightened acceleration radiation entropy or the HBAR entropy. We have carried out our analysis for a scalar field only to see the effect of the charge and rotation of the black hole in this particular scenario.


title: PySAGES: flexible, advanced sampling methods accelerated with GPUs

abstract: Molecular simulations are an important tool for research in physics, chemistry, and biology. The capabilities of simulations can be greatly expanded by providing access to advanced sampling methods and techniques that permit calculation of the relevant underlying free energy landscapes. In this sense, software that can be seamlessly adapted to a broad range of complex systems is essential. Building on past efforts to provide open-source community supported software for advanced sampling, we introduce PySAGES, a Python implementation of the Software Suite for Advanced General Ensemble Simulations (SSAGES) that provides full GPU support for massively parallel applications of enhanced sampling methods such as adaptive biasing forces, harmonic bias, or forward flux sampling in the context of molecular dynamics simulations. By providing an intuitive interface that facilitates the management of a system's configuration, the inclusion of new collective variables, and the implementation of sophisticated free energy-based sampling methods, the PySAGES library serves as a general platform for the development and implementation of emerging simulation techniques. The capabilities, core features, and computational performance of this new tool are demonstrated with clear and concise examples pertaining to different classes of molecular systems. We anticipate that PySAGES will provide the scientific community with a robust and easily accessible platform to accelerate simulations, improve sampling, and enable facile estimation of free energies for a wide range of materials and processes.


title: Improving mesh-based motion compensation by using edge adaptive graph-based compensated wavelet lifting for medical data sets

abstract: Medical applications like Computed Tomography (CT) or Magnetic Resonance Tomography (MRT) often require an efficient scalable representation of their huge output volumes in the further processing chain of medical routine. A downscaled version of such a signal can be obtained by using image and video coders based on wavelet transforms. The visual quality of the resulting lowpass band, which shall be used as a representative, can be improved by applying motion compensation methods during the transform. This paper presents a new approach of using the distorted edge lengths of a mesh-based compensated grid instead of the approximated intensity values of the underlying frame to perform a motion compensation. We will show that an edge adaptive graph-based compensation and its usage for compensated wavelet lifting improves the visual quality of the lowpass band by approximately 2.5 dB compared to the traditional mesh-based compensation, while the additional filesize required for coding the motion information doesn't change.


title: Some Characterisations of p-adic Analytic Groups

abstract: We give three necessary and sufficient conditions for a pro-p group to be p-adic analytic. We show that a noetherian pro-p group having finite chain length has a finite rank and conversely. We further deduce that a noetherian pro-p group has a finite rank precisely when it satisfies the weak descending chain condition. Using these results, we resolve a conjecture posed by Lubotzky and Mann in the affirmative within the class of noetherian groups which are countably based. Using these results, we answer a related conjecture about pro-p groups for the case of countably based pro-p groups. Namely, we prove that if every closed but non-open subgroup of a countably based pro-p group has finite rank, then the group is p-adic analytic and conversely.


title: LB-SimTSC: An Efficient Similarity-Aware Graph Neural Network for Semi-Supervised Time Series Classification

abstract: Time series classification is an important data mining task that has received a lot of interest in the past two decades. Due to the label scarcity in practice, semi-supervised time series classification with only a few labeled samples has become popular. Recently, Similarity-aware Time Series Classification (SimTSC) is proposed to address this problem by using a graph neural network classification model on the graph generated from pairwise Dynamic Time Warping (DTW) distance of batch data. It shows excellent accuracy and outperforms state-of-the-art deep learning models in several few-label settings. However, since SimTSC relies on pairwise DTW distances, the quadratic complexity of DTW limits its usability to only reasonably sized datasets. To address this challenge, we propose a new efficient semi-supervised time series classification technique, LB-SimTSC, with a new graph construction module. Instead of using DTW, we propose to utilize a lower bound of DTW, LB_Keogh, to approximate the dissimilarity between instances in linear time, while retaining the relative proximity relationships one would have obtained via computing DTW. We construct the pairwise distance matrix using LB_Keogh and build a graph for the graph neural network. We apply this approach to the ten largest datasets from the well-known UCR time series classification archive. The results demonstrate that this approach can be up to 104x faster than SimTSC when constructing the graph on large datasets without significantly decreasing classification accuracy.


title: Graph-based compensated wavelet lifting for 3-D+t medical CT data

abstract: An efficient scalable data representation is an important task especially in the medical area, e.g. for volumes from Computed Tomography (CT) or Magnetic Resonance Tomography (MRT), when a downscaled version of the original signal is needed. Image and video coders based on wavelet transforms provide an adequate way to naturally achieve scalability. This paper presents a new approach for improving the visual quality of the lowpass band by using a novel graph-based method for motion compensation, which is an important step considering data compression. We compare different kinds of neighborhoods for graph construction and demonstrate that a higher amount of referenced nodes increases the quality of the lowpass band while the mean energy of the highpass band decreases. We show that for cardiac CT data the proposed method outperforms a traditional mesh-based approach of motion compensation by approximately 11 dB in terms of PSNR of the lowpass band. Also the mean energy of the highpass band decreases by around 30%.


title: Centroid adapted frequency selective extrapolation for reconstruction of lost image areas

abstract: Lost image areas with different size and arbitrary shape can occur in many scenarios such as error-prone communication, depth-based image rendering or motion compensated wavelet lifting. The goal of image reconstruction is to restore these lost image areas as close to the original as possible. Frequency selective extrapolation is a block-based method for efficiently reconstructing lost areas in images. So far, the actual shape of the lost area is not considered directly. We propose a centroid adaption to enhance the existing frequency selective extrapolation algorithm that takes the shape of lost areas into account. To enlarge the test set for evaluation we further propose a method to generate arbitrarily shaped lost areas. On our large test set, we obtain an average reconstruction gain of 1.29 dB.


title: LZR: Identifying Unexpected Internet Services

abstract: Internet-wide scanning is a commonly used research technique that has helped uncover real-world attacks, find cryptographic weaknesses, and understand both operator and miscreant behavior. Studies that employ scanning have largely assumed that services are hosted on their IANA-assigned ports, overlooking the study of services on unusual ports. In this work, we investigate where Internet services are deployed in practice and evaluate the security posture of services on unexpected ports. We show protocol deployment is more diffuse than previously believed and that protocols run on many additional ports beyond their primary IANA-assigned port. For example, only 3% of HTTP and 6% of TLS services run on ports 80 and 443, respectively. Services on non-standard ports are more likely to be insecure, which results in studies dramatically underestimating the security posture of Internet hosts. Building on our observations, we introduce LZR ("Laser"), a system that identifies 99% of identifiable unexpected services in five handshakes and dramatically reduces the time needed to perform application-layer scans on ports with few responsive expected services (e.g., 5500% speedup on 27017/MongoDB). We conclude with recommendations for future studies.


title: Towards High Performance One-Stage Human Pose Estimation

abstract: Making top-down human pose estimation method present both good performance and high efficiency is appealing. Mask RCNN can largely improve the efficiency by conducting person detection and pose estimation in a single framework, as the features provided by the backbone are able to be shared by the two tasks. However, the performance is not as good as traditional two-stage methods. In this paper, we aim to largely advance the human pose estimation results of Mask-RCNN and still keep the efficiency. Specifically, we make improvements on the whole process of pose estimation, which contains feature extraction and keypoint detection. The part of feature extraction is ensured to get enough and valuable information of pose. Then, we introduce a Global Context Module into the keypoints detection branch to enlarge the receptive field, as it is crucial to successful human pose estimation. On the COCO val2017 set, our model using the ResNet-50 backbone achieves an AP of 68.1, which is 2.6 higher than Mask RCNN (AP of 65.5). Compared to the classic two-stage top-down method SimpleBaseline, our model largely narrows the performance gap (68.1 AP vs. 68.9 AP) with a much faster inference speed (77 ms vs. 168 ms), demonstrating the effectiveness of the proposed method. Code is available at: https://github.com/lingl_space/maskrcnn_keypoint_refined.


title: Scalar transport from deformed drops: the singular role of streamline topology

abstract: We examine scalar transport from a neutrally buoyant drop, in an ambient planar extensional flow, in the limit of a dominant drop phase resistance. For this interior problem, we consider the effect of drop-deformation-induced change in streamline topology on the transport rate (the Nusselt number $Nu$). The importance of drop deformation is characterized by the Capillary number ($Ca$). For a spherical drop ($Ca = 0$), closed streamlines lead to the ratio $Nu/Nu_0$ increasing with the Peclet number($Pe$), from unity to a diffusion-limited plateau value ($\approx 4.1$); $Nu_0$ here denotes the purely diffusive rate of transport. For any finite $Ca$, the flow field consists of spiralling streamlines that densely wind around nested tori foliating the deformed drop interior. $Nu$ now increases beyond the aforementioned primary plateau, saturating in a secondary plateau that approaches $23.3$ for $Ca \rightarrow 0$, $Pe Ca \rightarrow \infty$, and appears independent of the drop-to-medium viscosity ratio. $Nu/Nu_0$ exhibits an analogous variation for other planar linear flows, although chaotically wandering streamlines in these cases are expected to lead to a tertiary enhancement regime.


title: SACDNet: Towards Early Type 2 Diabetes Prediction with Uncertainty for Electronic Health Records

abstract: Type 2 diabetes mellitus (T2DM) is one of the most common diseases and a leading cause of death. The problem of early diagnosis of T2DM is challenging and necessary to prevent serious complications. This study proposes a novel neural network architecture for early T2DM prediction using multi-headed self-attention and dense layers to extract features from historic diagnoses, patient vitals, and demographics. The proposed technique is called the Self-Attention for Comorbid Disease Net (SACDNet), achieving an accuracy of 89.3% and an F1-Score of 89.1%, having a 1.6% increased accuracy and 1.3% increased f1-score compared to the baseline techniques. Monte Carlo (MC) Dropout is applied to the SACDNet to get a bayesian approximation. A T2DM prediction framework based on the MC Dropout SACDNet is proposed to quantize the uncertainty associated with the predictions. A T2DM prediction dataset is also built as part of this study which is based on real-world routine Electronic Health Record (EHR) data comprising 4,124 diabetic and 181,767 non-diabetic examples, collected from 295 different EHR systems running in different parts of the United States of America. This dataset is further used to evaluate 7 different machine learning and 3 deep learning-based models. Finally, a detailed analysis of the fairness of every technique against different patient demographic groups is performed to validate the unbiased generalization of the techniques and the diversity of the data.


title: A groupoid approach to regular $*$-semigroups

abstract: In this paper we develop a new groupoid-based structure theory for the class of regular $*$-semigroups. This class occupies something of a `sweet spot' between the important classes of inverse and regular semigroups, and contains many natural examples. Some of the most significant families include the partition, Brauer and Temperley-Lieb monoids, among other diagram monoids. Our main result is that the category of regular $*$-semigroups is isomorphic to the category of so-called `chained projection groupoids'. Such a groupoid is in fact a triple $(P,\mathcal G,\varepsilon)$, where: $\bullet$ $P$ is a projection algebra (in the sense of Imaoka and Jones), $\bullet$ $\mathcal G$ is an ordered groupoid with object set $P$, and $\bullet$ $\varepsilon:\mathscr C\to\mathcal G$ is a special functor, where $\mathscr C$ is a certain natural `chain groupoid' constructed from $P$. Roughly speaking: the groupoid $\mathcal G=\mathcal G(S)$ remembers only the `easy' products in a regular $*$-semigroup $S$; the projection algebra $P=P(S)$ remembers only the `conjugation action' of the projections of $S$; and the functor $\varepsilon=\varepsilon(S)$ tells us how $\mathcal G$ and $P$ `fit together' in order to recover the entire structure of $S$. In this way, we obtain the first completely general structure theorem for regular $*$-semigroups. As a consequence of our main result, we give a new proof of the celebrated Ehresmann--Schein--Nambooripad Theorem, which establishes an isomorphism between the categories of inverse semigroups and inductive groupoids. Other applications will be given in future works. We consider several examples along the way, and pose a number of problems that we believe are worthy of further attention.


title: Algebraic Model Management: A Survey

abstract: We survey the field of model management and describe a new model management approach based on algebraic specification.


title: Real-time FPGA implementation of the Semi-Global Matching stereo vision algorithm for a 4K/UHD video stream

abstract: In this paper, we propose a real-time FPGA implementation of the Semi-Global Matching (SGM) stereo vision algorithm. The designed module supports a 4K/Ultra HD (3840 x 2160 pixels @ 30 frames per second) video stream in a 4 pixel per clock (ppc) format and a 64-pixel disparity range. The baseline SGM implementation had to be modified to process pixels in the 4ppc format and meet the timing constrains, however, our version provides results comparable to the original design. The solution has been positively evaluated on the Xilinx VC707 development board with a Virtex-7 FPGA device.


title: $\tau$-quantization and $\tau$-Cohen classes distributions of Feichtinger operators

abstract: We investigate the $\tau$-quantizations and Cohen's class distributions of a suitable class of trace-class operators, called Feichtinger's operators, and show that it is a convenient substitute for the class of Schwartz operators. Many well-known concepts and results for functions in time-frequency analysis have an operator-analog in our setting, e.g. that Cohen's classes are convolutions of Wigner functions with distributions or characterization of the class of Schwartz operators as an intersection of weighted variants of the class of Feichtinger operators.