title: Deep Learning Segmentation and Classification of Red Blood Cells Using a Large Multi-Scanner Dataset

abstract: Digital pathology has recently been revolutionized by advancements in artificial intelligence, deep learning, and high-performance computing. With its advanced tools, digital pathology can help improve and speed up the diagnostic process, reduce human errors, and streamline the reporting step. In this paper, we report a new large red blood cell (RBC) image dataset and propose a two-stage deep learning framework for RBC image segmentation and classification. The dataset is a highly diverse dataset of more than 100K RBCs containing eight different classes. The dataset, which is considerably larger than any publicly available hematopathology dataset, was labeled independently by two hematopathologists who also manually created masks for RBC cell segmentation. Subsequently, in the proposed framework, first, a U-Net model was trained to achieve automatic RBC image segmentation. Second, an EfficientNetB0 model was trained to classify RBC images into one of the eight classes using a transfer learning approach with a 5X2 cross-validation scheme. An IoU of 98.03% and an average classification accuracy of 96.5% were attained on the test set. Moreover, we have performed experimental comparisons against several prominent CNN models. These comparisons show the superiority of the proposed model with a good balance between performance and computational cost.


title: Density-guided Translator Boosts Synthetic-to-Real Unsupervised Domain Adaptive Segmentation of 3D Point Clouds

abstract: 3D synthetic-to-real unsupervised domain adaptive segmentation is crucial to annotating new domains. Self-training is a competitive approach for this task, but its performance is limited by different sensor sampling patterns (i.e., variations in point density) and incomplete training strategies. In this work, we propose a density-guided translator (DGT), which translates point density between domains, and integrates it into a two-stage self-training pipeline named DGT-ST. First, in contrast to existing works that simultaneously conduct data generation and feature/output alignment within unstable adversarial training, we employ the non-learnable DGT to bridge the domain gap at the input level. Second, to provide a well-initialized model for self-training, we propose a category-level adversarial network in stage one that utilizes the prototype to prevent negative transfer. Finally, by leveraging the designs above, a domain-mixed self-training method with source-aware consistency loss is proposed in stage two to narrow the domain gap further. Experiments on two synthetic-to-real segmentation tasks (SynLiDAR $\rightarrow$ semanticKITTI and SynLiDAR $\rightarrow$ semanticPOSS) demonstrate that DGT-ST outperforms state-of-the-art methods, achieving 9.4$\%$ and 4.3$\%$ mIoU improvements, respectively. Code is available at \url{https://github.com/yuan-zm/DGT-ST}.


title: Generalized bulk-boundary correspondence in periodically driven non-Hermitian systems

abstract: We present a pedagogical review of the periodically driven non-Hermitian systems, particularly on the rich interplay between the non-Hermitian skin effect and the topology. We start by reviewing the non-Bloch band theory of the static non-Hermitian systems and discuss the establishment of its generalized bulk-boundary correspondence. Ultimately, we focus on the non-Bloch band theory of two typical periodically driven non-Hermitian systems: harmonically driven non-Hermitian system and periodically quenched non-Hermitian system. The non-Bloch topological invariants were defined on the generalized Brillouin zone and the real space wave functions to characterize the Floquet non-Hermtian topological phases. Then, the generalized bulk-boundary correspondence was established for the two typical periodically driven non-Hermitian systems. Additionally, we review novel phenomena in the higher-dimensional periodically driven non-Hermitian systems, including Floquet non-Hermitian higher-order topological phases and Floquet hybrid skin-topological modes. The experimental realizations and recent advances have also been surveyed. Finally, we end with a summarization and hope this pedagogical review can motivate further research on Floquet non-Hermtian topological physics.


title: DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysis

abstract: The rapid progress in deep learning has given rise to hyper-realistic facial forgery methods, leading to concerns related to misinformation and security risks. Existing face forgery datasets have limitations in generating high-quality facial images and addressing the challenges posed by evolving generative techniques. To combat this, we present DiffusionFace, the first diffusion-based face forgery dataset, covering various forgery categories, including unconditional and Text Guide facial image generation, Img2Img, Inpaint, and Diffusion-based facial exchange algorithms. Our DiffusionFace dataset stands out with its extensive collection of 11 diffusion models and the high-quality of the generated images, providing essential metadata and a real-world internet-sourced forgery facial image dataset for evaluation. Additionally, we provide an in-depth analysis of the data and introduce practical evaluation protocols to rigorously assess discriminative models' effectiveness in detecting counterfeit facial images, aiming to enhance security in facial image authentication processes. The dataset is available for download at \url{https://github.com/Rapisurazurite/DiffFace}.


title: Computational decomposition and composition technique for approximate solution of nonstationary problems

abstract: Stable computational algorithms for the approximate solution of the Cauchy problem for nonstationary problems are based on implicit time approximations. Computational costs for boundary value problems for systems of coupled multidimensional equations can be reduced by additive decomposition of the problem operator(s) and composition of the approximate solution using particular explicit-implicit time approximations. Such a technique is currently applied in conditions where the decomposition step is uncomplicated. A general approach is proposed to construct decomposition-composition algorithms for evolution equations in finite-dimensional Hilbert spaces. It is based on two main variants of the decomposition of the unit operator in the corresponding spaces at the decomposition stage and the application of additive operator-difference schemes at the composition stage. The general results are illustrated on the boundary value problem for a second-order parabolic equation by constructing standard splitting schemes on spatial variables and region-additive schemes (domain decomposition schemes).


title: DMRG-tailored coupled cluster method in the 4c-relativistic domain: General implementation and application to the NUHFI and NUF$_3$ molecules

abstract: Heavy atom compounds represent a challenge for computational chemistry, due to the need for simultaneous treatment of relativistic and correlation effects. Often such systems exhibit also strong correlation which hampers the application of perturbation theory or single-reference coupled cluster (CC) methods. As a viable alternative, we have proposed to externally correct the CC method using the density matrix renormalization group (DMRG) wave functions, yielding the DMRG-tailored CC method. In a previous paper [J. Chem. Phys. {\bf 152}, 174107 (2020)] we have reported a first implementation of this method in the relativistic context, which was restricted to molecules with real double group symmetry. In this work we present a fully general implementation of the method, covering complex and quaternion double groups as well. The 4c-TCC method thus becomes applicable to polyatomic molecules including heavy atoms. For assessment of the method, we performed calculations of the chiral uranium compound NUHFI, which was previously studied in the context of the enhancement of parity violation effects. In particular, we performed calculations of a cut of the potential energy surface of this molecule along the dissociation of the N-U bond, where the system exhibits a strong multireference character. Since there are no experimental data for NUHFI, we have performed also an analogous study of the (more symmetric) NUF$_3$ molecule, where the vibrational frequency of the N-U bond can be compared with spectroscopic data.


title: Fermi and eROSITA Bubbles as Persistent Structures of The Milky Way Galaxy

abstract: The Fermi and eROSITA bubbles, large diffuse structures in our Galaxy, can be the by-products of the steady star formation activity. To simultaneously explain the star formation history of the Milky Way and the metallicity of $\sim$ Z$_\odot$ at the Galactic disk, a steady Galactic wind driven by cosmic-rays is required. For tenuous gases with a density of $\lesssim$10$^{-3}$ cm$^{-3}$, the cosmic-ray heating dominates over radiative cooling, and the gas can maintain the virial temperature of $\sim$0.3 keV ideal for escape from the Galactic system as the wind. A part of the wind falls back onto the disk like a galactic fountain flow. We model the wind dynamics according to the Galactic evolution scenario and find that the scale height and surface brightness of the X-ray and the hadronic gamma-ray emissions from such fountain flow region can be consistent with the observed properties of the Fermi and eROSITA bubbles. This implies that the bubbles are persistent structures of the Milky Way existing over (at least) the last $\sim$1 Gyr, rather than evanescent structures formed by non-trivial, $\sim$10 Myr past Galactic Center transient activities.


title: Record cryogenic cooling in ferroelectric hafnia proximity induced via Mott transition

abstract: On-chip refrigeration at cryogenic temperatures is becoming an important requirement in the context of quantum technologies and nanoelectronics. Ferroic materials with enhanced electrocaloric effects at phase transitions are good material candidates for the same. By exploiting the Mott metal-insulator transition (MIT) of TiOx(Ny), the bottom electrode, we engineer a depolarization field controlled reversible polar to non-polar phase transition in thick La-doped hafnia (40 nm). This transition occurs between ~125 and 140 K and produces giant negative pyroelectric and electrocaloric effects. Refrigeration metrics were estimated between 120 to 200 K, with a peak refrigerant capacity of 25 kJ Kg-1 (2 kJ Kg-1), peak isothermal entropy {\Delta}S~ 8 kJ Kg-1 K-1 (0.5 kJ Kg-1 K-1) and adiabatic {\Delta}Tcooling ~ 106 K (11 K) at ~140 K and 5 MV cm-1 (0.5 MV cm-1, and these are the largest reported in any electrocaloric system. Our work fundamentally proposes design guidelines to induce significant solid-state refrigeration through proximity effects, even at cryogenic temperatures relevant to quantum technologies.


title: Modeling uncertainty for Gaussian Splatting

abstract: We present Stochastic Gaussian Splatting (SGS): the first framework for uncertainty estimation using Gaussian Splatting (GS). GS recently advanced the novel-view synthesis field by achieving impressive reconstruction quality at a fraction of the computational cost of Neural Radiance Fields (NeRF). However, contrary to the latter, it still lacks the ability to provide information about the confidence associated with their outputs. To address this limitation, in this paper, we introduce a Variational Inference-based approach that seamlessly integrates uncertainty prediction into the common rendering pipeline of GS. Additionally, we introduce the Area Under Sparsification Error (AUSE) as a new term in the loss function, enabling optimization of uncertainty estimation alongside image reconstruction. Experimental results on the LLFF dataset demonstrate that our method outperforms existing approaches in terms of both image rendering quality and uncertainty estimation accuracy. Overall, our framework equips practitioners with valuable insights into the reliability of synthesized views, facilitating safer decision-making in real-world applications.


title: Thermalization condition for non-Hermitian quantum systems

abstract: The application of the eigenstate thermalization hypothesis to non-Hermitian quantum systems has become one of the most important topics in dissipative quantum chaos, recently giving rise to intense debates. The process of thermalization is intricate, involving many time-evolution trajectories in the reduced Hilbert space of the system. By considering two different expansion forms of the density matrices adopted in the biorthogonal and right-state time evolutions, we have derived two versions of the Gorini-Kossakowski-Sudarshan-Lindblad master equations describing the non-Hermitian systems coupled to a bosonic heat bath in thermal equilibrium. By solving the equations, we have identified a sufficient condition for thermalization under both time evolutions, resulting in Boltzmann biorthogonal and right-eigenstate statistics, respectively. This finding implies that the recently proposed biorthogonal random matrix theory needs an appropriate revision. Moreover, we have exemplified the precise dynamics of thermalization and thermodynamic properties with test models.


title: A consistent kinetic Fokker-Planck model for gas mixtures

abstract: Rarefied gas dynamics is usually described by the Boltzmann equation. Unfortunately, the expense of evaluating this operator can be very prohibitive. This made it worthwhile to look for approximations that convey essentially an equivalent amount of physical information. One widely known approximative collision operator is the Bathnagar-Gross-Krook (BGK) operator. However, recently, the Foker-Planck approximation has become increasingly popular. Nevertheless, the modeling of gas mixtures in the context of the kinetic Fokker-Planck equation has so far only been addressed in a very few papers. In this paper, we propose a general multi-species Fokker-Planck model. We prove consistency of our model: conservation properties, positivity of all temperatures, H-Theorem and the shape of equilibrium as Maxwell distributions with the same mean velocity and temperature. Moreover, we derive the usual macroscopic equations.


abstract: Graph neural networks (GNNs) are currently one of the most performant collaborative filtering methods. Meanwhile, owing to the use of an embedding table to represent each user/item as a distinct vector, GNN-based recommenders have inherited the long-standing defect of parameter inefficiency. As a common practice for scalable embeddings, parameter sharing enables the use of fewer embedding vectors (i.e., meta-embeddings). When assigning meta-embeddings, most existing methods are a heuristically designed, predefined mapping from each user's/item's ID to the corresponding meta-embedding indexes, thus simplifying the optimization problem into learning only the meta-embeddings. However, in the context of GNN-based collaborative filtering, such a fixed mapping omits the semantic correlations between entities that are evident in the user-item interaction graph, leading to suboptimal recommendation performance. To this end, we propose Lightweight Embeddings for Graph Collaborative Filtering (LEGCF), a parameter-efficient embedding framework dedicated to GNN-based recommenders. LEGCF innovatively introduces an assignment matrix as an extra learnable component on top of meta-embeddings. To jointly optimize these two heavily entangled components, aside from learning the meta-embeddings by minimizing the recommendation loss, LEGCF further performs efficient assignment update by enforcing a novel semantic similarity constraint and finding its closed-form solution based on matrix pseudo-inverse. The meta-embeddings and assignment matrix are alternately updated, where the latter is sparsified on the fly to ensure negligible storage overhead. Extensive experiments on three benchmark datasets have verified LEGCF's smallest trade-off between size and performance, with consistent accuracy gain over state-of-the-art baselines. The codebase of LEGCF is available in https://github.com/xurong-liang/LEGCF.


title: Enhanced Generative Recommendation via Content and Collaboration Integration

abstract: Generative recommendation has emerged as a promising paradigm aimed at augmenting recommender systems with recent advancements in generative artificial intelligence. This task has been formulated as a sequence-to-sequence generation process, wherein the input sequence encompasses data pertaining to the user's previously interacted items, and the output sequence denotes the generative identifier for the suggested item. However, existing generative recommendation approaches still encounter challenges in (i) effectively integrating user-item collaborative signals and item content information within a unified generative framework, and (ii) executing an efficient alignment between content information and collaborative signals. In this paper, we introduce content-based collaborative generation for recommender systems, denoted as ColaRec. To capture collaborative signals, the generative item identifiers are derived from a pretrained collaborative filtering model, while the user is represented through the aggregation of interacted items' content. Subsequently, the aggregated textual description of items is fed into a language model to encapsulate content information. This integration enables ColaRec to amalgamate collaborative signals and content information within an end-to-end framework. Regarding the alignment, we propose an item indexing task to facilitate the mapping between the content-based semantic space and the interaction-based collaborative space. Additionally, a contrastive loss is introduced to ensure that items with similar collaborative GIDs possess comparable content representations, thereby enhancing alignment. To validate the efficacy of ColaRec, we conduct experiments on three benchmark datasets. Empirical results substantiate the superior performance of ColaRec.


title: On the properties of free floating planets originating in circumbinary planetary systems

abstract: Free-floating planets are a new class of planets recently discovered. These planets don't orbit within stellar systems, instead living a nomadic life within the galaxy. How such objects formed remains elusive. Numerous works have explored mechanisms to form such objects, but have not yet provided predictions on their distributions that could differentiate between formation mechanisms. In this work we form these objects within circumbinary systems, where these planets are readily formed and ejected through interactions with the central binary stars. We find significant differences between planets ejected through planet-planet interactions and those by the binary stars. The main differences that arise are in the distributions of excess velocity, where binary stars eject planets with faster velocities. These differences should be observable amongst known free-floating planets in nearby star-forming regions. We predict that targeted observations of directly imaged free-floating planets in these regions should be able to determine their preferred formation pathway, either by planet formation in single or multiple stellar systems, or through processes akin to star formation. Additionally the mass distributions of free-floating planets can yield important insights into the underlying planet populations. We find that for planets more massive than 20 $\rm M_{\oplus}$, their frequencies are similar to those planets remaining bound and orbiting near the central binaries. This similarity allows for effective and informative comparisons between mass distributions from microlensing surveys, to those of transit and radial velocities. Ultimately, by observing the velocity dispersion and mass distribution of free-floating planets, it will be possible to effectively compare with predictions from planet formation models, and to further understand the formation and evolution of these exotic worlds.


title: UVL Sentinel: a tool for parsing and syntactic correction of UVL datasets

abstract: Feature models have become a de facto standard for representing variability in software product lines. UVL (Universal Variability Language) is a language which expresses the features, dependencies, and constraints between them. This language is written in plain text and follows a syntactic structure that needs to be processed by a parser. This parser is software with specific syntactic rules that the language must comply with to be processed correctly. Researchers have datasets with numerous feature models. The language description form of these feature models is tied to a version of the parser language. When the parser is updated to support new features or correct previous ones, these feature models are often no longer compatible, generating incompatibilities and inconsistency within the dataset. In this paper, we present UVL Sentinel. This tool analyzes a dataset of feature models in UVL format, generating error analysis reports, describing those errors and, eventually, a syntactic processing that applies the most common solutions. This tool can detect the incompatibilities of the feature models of a dataset when the parser is updated and tries to correct the most common syntactic errors, facilitating the management of the dataset and the adaptation of their models to the new version of the parser. Our tool was evaluated using a dataset of 1,479 UVL models from different sources and helped semi-automatically fix 185 warnings and syntax errors.


title: Existence and role of low energy charge-paramagnon modes in the strange metal phase of Bi$_2$Sr$_2$CaCu$_2$O$_{8+y}$

abstract: The strange metal phase is characteristic for the $T$-linear dc resistivity behaviour over a large $T$-range. The effect of the strength of the charge-paramagnon interactions on the charge fluctuations in optimally doped and underdoped regions of Bi$_2$Sr$_2$CaCu$_2$O$_{8+y}$ (Bi-2212) may shine light on the anomalous behaviour of the optical conductivity response in the energy range 50 - 500 meV. We present a preliminary analysis of a single initial run of electron energy loss spectroscopy (EELS) measurements done in a scanning transmission electron microscope (STEM) which exhibit linear dispersive modes separated by 50 meV energy gaps up to 250 meV in optimally doped Bi-2212. Our observations show similarities with the fluctuating stripes as predicted by Zaanen.


title: Stellar wind bubbles of OB stars as Galactic cosmic-ray re-accelerators

abstract: Cosmic rays are highly energetic messengers propagating in magnetized plasma, which are, possibly but not exclusively, accelerated at astrophysical shocks. Amongst the variety of astrophysical objects presenting shocks, the huge circumstellar stellar wind bubbles forming around very massive stars, are potential non thermal emitters. We present the 1D magnetohydrodynamical simulation of the evolving magnetized surroundings of a single, OB type main sequence 60 Mo star, which is post processed to calculate the re-acceleration of preexisting non-thermal particles of the Galactic cosmic ray background. It is found that the forward shock of such circumstellar bubble can, during the early phase (1 Myr) of its expansion, act as a substantial reaccelerator of pre existing interstellar cosmic rays. This results in an increasing excess emission flux by a factor of 5, the hadronic component producing gamma-rays by pion0 decay being more important than those by synchrotron and inverse Compton radiation mechanisms. We propose that this effect is at work in the circumstellar environments of massive stars in general and we conjecture that other nebulae such as the stellar wind bow shocks of runaway massive stars also act as Galactic cosmic-ray re-accelerators. Particularly, this study supports the interpretation of the enhanced hadronic emission flux measured from the surroundings of kappa Ori as originating from the acceleration of pre-existing particles at the forward shock of its wind bubble.


title: Rashba spin splitting-induced topological Hall effect in a Dirac semimetal-ferromagnetic semiconductor heterostructure

abstract: We use a concerted theory-experiment effort to investigate the formation of chiral real space spin texture when the archetypal Dirac semimetal Cd$_3$As$_2$ is interfaced with In$_{1-x}$Mn$_x$As, a ferromagnetic semiconductor with perpendicular magnetic anisotropy. Our calculations reveal a nonzero off-diagonal spin susceptibility in the Cd$_3$As$_2$ layer due to the Rashba spin-orbit coupling from broken inversion symmetry. This implies the presence of a Dzyaloshinskii-Moriya interaction between local moments in the In$_{1-x}$Mn$_x$As layer, mediated by Dirac electrons in the vicinal Cd$_3$As$_2$ layer, potentially creating the conditions for a real space chiral spin texture. Using electrical magnetoresistance measurements at low temperature, we observe an emergent excess contribution to the transverse magneto-resistance whose behavior is consistent with a topological Hall effect arising from the formation of an interfacial chiral spin texture. This excess Hall voltage varies with gate voltage, indicating a promising electrostatically-tunable platform for understanding the interplay between the helical momentum space states of a Dirac semimetal and chiral real space spin textures in a ferromagnet.


title: Synthesizing EEG Signals from Event-Related Potential Paradigms with Conditional Diffusion Models

abstract: Data scarcity in the brain-computer interface field can be alleviated through the use of generative models, specifically diffusion models. While diffusion models have previously been successfully applied to electroencephalogram (EEG) data, existing models lack flexibility w.r.t.~sampling or require alternative representations of the EEG data. To overcome these limitations, we introduce a novel approach to conditional diffusion models that utilizes classifier-free guidance to directly generate subject-, session-, and class-specific EEG data. In addition to commonly used metrics, domain-specific metrics are employed to evaluate the specificity of the generated samples. The results indicate that the proposed model can generate EEG data that resembles real data for each subject, session, and class.


title: Singularity: a Seventh Memo?

abstract: In this paper we explore the relationships between Calvino's memos and Mathematics. In the first part, we discuss how Lightness, Quickness, Exactitude, Visibility, Multiplicity are present in the mathematical language, reasoning and in the work of the mathematician. In addiction, we follow a similar path for the topics of Calvino's lecture of which we only know the title or some notes. In the final part, we explain why `Singularity' could be chosen as topic for Calvino's seventh lecture.


title: The Guesswork of Ordered Statistics Decoding: Complexity and Practical Design

abstract: This paper investigates guesswork over ordered statistics and formulates the complexity of ordered statistics decoding (OSD) in binary additive white Gaussian noise (AWGN) channels. It first develops a new upper bound of guesswork for independent sequences, by applying the Holder's inequity to Hamming shell-based subspaces. This upper bound is then extended to the ordered statistics, by constructing the conditionally independent sequences within the ordered statistics sequences. We leverage the established bounds to formulate the best achievable decoding complexity of OSD that ensures no loss in error performance, where OSD stops immediately when the correct codeword estimate is found. We show that the average complexity of OSD at maximum decoding order can be accurately approximated by the modified Bessel function, which increases near-exponentially with code dimension. We also identify a complexity saturation threshold, where increasing the OSD decoding order beyond this threshold improves error performance without further raising decoding complexity. Finally, the paper presents insights on applying these findings to enhance the efficiency of practical decoder implementations.


title: Impact of Employing Weather Forecast Data as Input to the Estimation of Evapotranspiration by Deep Neural Network Models

abstract: Reference Evapotranspiration (ET0) is a key parameter for designing smart irrigation scheduling, since it is related by a coefficient to the water needs of a crop. The United Nations Food and Agriculture Organization, proposed a standard method for ET0 computation (FAO56PM), based on the parameterization of the Penman-Monteith equation, that is widely adopted in the literature. To compute ET0 using the FAO56-PM method, four main weather parameters are needed: temperature, humidity, wind, and solar radiation (SR). One way to make daily ET0 estimations for future days is to use freely available weather forecast services (WFSs), where many meteorological parameters are estimated up to the next 15 days. A problem with this method is that currently, SR is not provided as a free forecast parameter on most of those online services or, normally, such forecasts present a financial cost penalty. For this reason, several ET0 estimation models using machine and deep learning were developed and presented in the literature, that use as input features a reduced set of carefully selected weather parameters, that are compatible with common freely available WFSs. However, most studies on this topic have only evaluated model performance using data from weather stations (WSs), without considering the effect of using weather forecast data. In this study, the performance of authors' previous models is evaluated when using weather forecast data from two online WFSs, in the following scenarios: (i) direct ET0 estimation by an ANN model, and (ii) estimate SR by ANN model, and then use that estimation for ET0 computation, using the FAO56-PM method. Employing data collected from two WFSs and a WS located in Vale do Lobo, Portugal, the latter approach achieved the best result, with a coefficient of determination (R2) ranging between 0.893 and 0.667, when considering forecasts up to 15 days.


title: I2CKD : Intra- and Inter-Class Knowledge Distillation for Semantic Segmentation

abstract: This paper proposes a new knowledge distillation method tailored for image semantic segmentation, termed Intra- and Inter-Class Knowledge Distillation (I2CKD). The focus of this method is on capturing and transferring knowledge between the intermediate layers of teacher (cumbersome model) and student (compact model). For knowledge extraction, we exploit class prototypes derived from feature maps. To facilitate knowledge transfer, we employ a triplet loss in order to minimize intra-class variances and maximize inter-class variances between teacher and student prototypes. Consequently, I2CKD enables the student to better mimic the feature representation of the teacher for each class, thereby enhancing the segmentation performance of the compact network. Extensive experiments on three segmentation datasets, i.e., Cityscapes, Pascal VOC and CamVid, using various teacher-student network pairs demonstrate the effectiveness of the proposed method.


title: Algorithmic Details behind the Predator Shape Analyser

abstract: This chapter, which is an extended and revised version of the conference paper 'Predator: Byte-Precise Verification of Low-Level List Manipulation', concentrates on a detailed description of the algorithms behind the Predator shape analyser based on abstract interpretation and symbolic memory graphs. Predator is particularly suited for formal analysis and verification of sequential non-recursive C code that uses low-level pointer operations to manipulate various kinds of linked lists of unbounded size as well as various other kinds of pointer structures of bounded size. The tool supports practically relevant forms of pointer arithmetic, block operations, address alignment, or memory reinterpretation. We present the overall architecture of the tool, along with selected implementation details of the tool as well as its extension into so-called Predator Hunting Party, which utilises multiple concurrently-running Predator analysers with various restrictions on their behaviour. Results of experiments with Predator within the SV-COMP competition as well as on our own benchmarks are provided.


title: Anomalous terahertz photoconductivity caused by the superballistic flow of hydrodynamic electrons in graphene

abstract: Light incident upon materials can induce changes in their electrical conductivity, a phenomenon referred to as photoresistance. In semiconductors, the photoresistance is negative, as light-induced promotion of electrons across the band gap enhances the number of charge carriers participating in transport. In superconductors, the photoresistance is positive because of the destruction of the superconducting state, whereas in normal metals it is vanishing. Here we report a qualitative deviation from the standard behavior in metallic graphene. We show that Dirac electrons exposed to continuous wave (CW) terahertz (THz) radiation can be thermally decoupled from the lattice by 50~K which activates hydrodynamic electron transport. In this regime, the resistance of graphene constrictions experiences a decrease caused by the THz-driven superballistic flow of correlated electrons. We analyze the dependencies of the negative photoresistance on the carrier density, and the radiation power and show that our superballistic devices operate as sensitive phonon-cooled bolometers and can thus offer a picosecond-scale response time. Beyond their fundamental implications, our findings underscore the practicality of electron hydrodynamics in designing ultra-fast THz sensors and electron thermometers.


title: VersaT2I: Improving Text-to-Image Models with Versatile Reward

abstract: Recent text-to-image (T2I) models have benefited from large-scale and high-quality data, demonstrating impressive performance. However, these T2I models still struggle to produce images that are aesthetically pleasing, geometrically accurate, faithful to text, and of good low-level quality. We present VersaT2I, a versatile training framework that can boost the performance with multiple rewards of any T2I model. We decompose the quality of the image into several aspects such as aesthetics, text-image alignment, geometry, low-level quality, etc. Then, for every quality aspect, we select high-quality images in this aspect generated by the model as the training set to finetune the T2I model using the Low-Rank Adaptation (LoRA). Furthermore, we introduce a gating function to combine multiple quality aspects, which can avoid conflicts between different quality aspects. Our method is easy to extend and does not require any manual annotation, reinforcement learning, or model architecture changes. Extensive experiments demonstrate that VersaT2I outperforms the baseline methods across various quality criteria.


title: Learning in PINNs: Phase transition, total diffusion, and generalization

abstract: We investigate the learning dynamics of fully-connected neural networks through the lens of gradient signal-to-noise ratio (SNR), examining the behavior of first-order optimizers like Adam in non-convex objectives. By interpreting the drift/diffusion phases in the information bottleneck theory, focusing on gradient homogeneity, we identify a third phase termed ``total diffusion", characterized by equilibrium in the learning rates and homogeneous gradients. This phase is marked by an abrupt SNR increase, uniform residuals across the sample space and the most rapid training convergence. We propose a residual-based re-weighting scheme to accelerate this diffusion in quadratic loss functions, enhancing generalization. We also explore the information compression phenomenon, pinpointing a significant saturation-induced compression of activations at the total diffusion phase, with deeper layers experiencing negligible information loss. Supported by experimental data on physics-informed neural networks (PINNs), which underscore the importance of gradient homogeneity due to their PDE-based sample inter-dependence, our findings suggest that recognizing phase transitions could refine ML optimization strategies for improved generalization.


title: Direct mineral content prediction from drill core images via transfer learning

abstract: Deep subsurface exploration is important for mining, oil and gas industries, as well as in the assessment of geological units for the disposal of chemical or nuclear waste, or the viability of geothermal energy systems. Typically, detailed examinations of subsurface formations or units are performed on cuttings or core materials extracted during drilling campaigns, as well as on geophysical borehole data, which provide detailed information about the petrophysical properties of the rocks. Depending on the volume of rock samples and the analytical program, the laboratory analysis and diagnostics can be very time-consuming. This study investigates the potential of utilizing machine learning, specifically convolutional neural networks (CNN), to assess the lithology and mineral content solely from analysis of drill core images, aiming to support and expedite the subsurface geological exploration. The paper outlines a comprehensive methodology, encompassing data preprocessing, machine learning methods, and transfer learning techniques. The outcome reveals a remarkable 96.7% accuracy in the classification of drill core segments into distinct formation classes. Furthermore, a CNN model was trained for the evaluation of mineral content using a learning data set from multidimensional log analysis data (silicate, total clay, carbonate). When benchmarked against laboratory XRD measurements on samples from the cores, both the advanced multidimensional log analysis model and the neural network approach developed here provide equally good performance. This work demonstrates that deep learning and particularly transfer learning can support extracting petrophysical properties, including mineral content and formation classification, from drill core images, thus offering a road map for enhancing model performance and data set quality in image-based analysis of drill cores.


title: Nijenhuis deformations of Poisson algebras and $F$-manifold algebras

abstract: The notion of pre-Poisson algebras was introduced by Aguiar in his study of zinbiel algebras and pre-Lie algebras. In this paper, we first introduce NS-Poisson algebras as a generalization of both Poisson algebras and pre-Poisson algebras. An NS-Poisson algebra has an associated sub-adjacent Poisson algebra. We show that a Nijenhuis operator on a Poisson algebra deforms the structure into an NS-Poisson algebra. The semi-classical limit of an NS-algebra deformation and a suitable filtration of an NS-algebra produce NS-Poisson algebras. On the other hand, $F$-manifold algebras were introduced by Dotsenko as the underlying algebraic structure of $F$-manifolds. We also introduce NS-$F$-manifold algebras as a simultaneous generalization of NS-Poisson algebras, $F$-manifold algebras and pre-$F$-manifold algebras. In the end, we show that Nijenhuis deformations of $F$-manifold algebras and the semi-classical limits of NS-pre-Lie algebra deformations have NS-$F$-manifold algebra structures.


title: Minimum sum vertex cover: kernelization and parameterized algorithms

abstract: Given an ordering of the vertices of a graph, the cost of covering an edge is the smaller number of its two ends. The minimum sum vertex cover problem asks for an ordering that minimizes the total cost of covering all edges. We consider parameterized complexity of this problem, using the largest cost~$k$ of covering a single edge as the parameter. Note that the first $k$ vertices form a (not necessarily minimal) vertex cover of the graph, and the ordering of vertices after $k$ is irrelevant. We present a $(k^2 + 2 k)$-vertex kernel and an $O(m + 2^kk! k^4)$-time algorithm for the minimum sum vertex cover problem, where $m$ is the size of the input graph. Since our parameter~$k$ is polynomially bounded by the vertex cover number of the input graph, our results also apply to that parameterization.


title: Global Representation Ring and Knutson Index

abstract: Global representation rings were discovered by Sarah Witherspoon in 1995 and the Knutson Index was introduced by the second author in 2022. In the present paper we introduce the Knutson Index for general commutative rings and study it for Burnside rings and global representation rings. We also introduce the global table of a finite group, that encompasses both the character table and the Burnside table of marks. We discuss what properties of a group can be recovered from its global table.


title: Mechanisms of THz Radiation in Laser-Plasma Interactions

abstract: The exploration of Terahertz (THz) waves has captivated researchers across diverse scientific disciplines such as physics, spectroscopy, chemistry, biology, and engineering, driven by the myriad applications these waves offer. Within this expansive landscape, the development of efficient and reliable THz sources stands as a paramount objective. In the pursuit of this goal, a multitude of approaches have been undertaken, with a notable contender emerging in the form of laser-induced plasma. Harnessing the advancements in ultrafast pulses, laser-induced plasma has proven to be a promising tool for generating THz waves. Its appeal lies in the robust attributes of a high power threshold, intense THz signal, and an broadband THz spectrum. This paper delves into a comprehensive review of the physics and progress underlying THz generation from laser-induced plasmas, exploring scenarios where plasmas are induced in gases, liquids, and solids. The interactions between lasers and plasmas involve complex physical processes, resulting in a variety of laser plasma scenarios for THz generation. In this review, the focus is specifically placed on classifying THz generation based on different physical mechanisms and also examines the characteristics of the emitted THz waves. By categorizing the processes, a deeper understanding of the underlying principles can be attained.


title: Global unique solutions to the planar inhomogeneous Navier--Stokes--Maxwell equations

abstract: The evolution of an electrically conducting imcompressible fluid with nonconstant density can be described by a set of equations combining the continuity, momentum and Maxwell's equations; altogether known as the inhomogeneous Navier--Stokes--Maxwell system. In this paper, we focus on the global well-posedness of these equations in two dimensions. Specifically, we are able to prove the existence of global energy solutions, provided that the initial velocity field belongs to the Besov space $\dot{B}^{r}_{p,1}(\mathbb{R}^2)$, with $r=-1+\frac{2}{p}$, for some $p\in (1,2)$, while the initial electromagnetic field enjoys some $H^s(\mathbb{R}^2)$ Sobolev regularity, for some $s \geq 2-\frac{2}{p} \in (0,1)$, and whenever the initial fluid density is bounded pointwise and close to a nonnegative constant. Moreover, if it is assumed that $s>\frac{1}{2}$, then the solution is shown to be unique in the class of all energy solutions. It is to be emphasized that the solutions constructed here are global and uniformly bounded with respect to the speed of light $c\in (0,\infty)$. This important fact allows us to derive the inhomogeneous MHD system as the speed of light tends to infinity.


title: HEMIT: H&E to Multiplex-immunohistochemistry Image Translation with Dual-Branch Pix2pix Generator

abstract: Computational analysis of multiplexed immunofluorescence histology data is emerging as an important method for understanding the tumour micro-environment in cancer. This work presents HEMIT, a dataset designed for translating Hematoxylin and Eosin (H&E) sections to multiplex-immunohistochemistry (mIHC) images, featuring DAPI, CD3, and panCK markers. Distinctively, HEMIT's mIHC images are multi-component and cellular-level aligned with H&E, enriching supervised stain translation tasks. To our knowledge, HEMIT is the first publicly available cellular-level aligned dataset that enables H&E to multi-target mIHC image translation. This dataset provides the computer vision community with a valuable resource to develop novel computational methods which have the potential to gain new insights from H&E slide archives. We also propose a new dual-branch generator architecture, using residual Convolutional Neural Networks (CNNs) and Swin Transformers which achieves better translation outcomes than other popular algorithms. When evaluated on HEMIT, it outperforms pix2pixHD, pix2pix, U-Net, and ResNet, achieving the highest overall score on key metrics including the Structural Similarity Index Measure (SSIM), Pearson correlation score (R), and Peak signal-to-noise Ratio (PSNR). Additionally, downstream analysis has been used to further validate the quality of the generated mIHC images. These results set a new benchmark in the field of stain translation tasks.


title: A Novel Proton Decay Signature at DUNE, JUNO, and Hyper-K

abstract: Proton decay, although unobserved so far, is a natural expectation when attempting to explain the baryon asymmetry of the universe. $p\to K^+\bar{\nu}$ or $p\to K^+\tilde{\chi}_1^0$, with $\tilde{\chi}_1^0$ a light exotic neutral particle, represent possible decay channels achievable in models of physics beyond the Standard Model, such as the MSSM with trilinear R-parity-violating terms, or the Standard Model extended by a heavy neutral lepton. Among the decay products of these modes, the neutral fermions would typically appear as missing energy in collider searches. The present study considers how such decay modes could be differentiated in experimental settings, as the exotic $\tilde{\chi}_1^0$ may further decay if it is not protected by a symmetry (such as R-parity in the MSSM). We assess the detection prospects of the proposed experiments DUNE, JUNO and Hyper-K in this context.


title: Distributional Treatment Effect with Latent Rank Invariance

abstract: Treatment effect heterogeneity is of a great concern when evaluating the treatment. However, even with a simple case of a binary random treatment, the distribution of treatment effect is difficult to identify due to the fundamental limitation that we cannot observe both treated potential outcome and untreated potential outcome for a given individual. This paper assumes a conditional independence assumption that the two potential outcomes are independent of each other given a scalar latent variable. Using two proxy variables, we identify conditional distribution of the potential outcomes given the latent variable. To pin down the location of the latent variable, we assume strict monotonicty on some functional of the conditional distribution; with specific example of strictly increasing conditional expectation, we label the latent variable as 'latent rank' and motivate the identifying assumption as 'latent rank invariance.'


title: AcTED: Automatic Acquisition of Typical Event Duration for Semi-supervised Temporal Commonsense QA

abstract: We propose a voting-driven semi-supervised approach to automatically acquire the typical duration of an event and use it as pseudo-labeled data. The human evaluation demonstrates that our pseudo labels exhibit surprisingly high accuracy and balanced coverage. In the temporal commonsense QA task, experimental results show that using only pseudo examples of 400 events, we achieve performance comparable to the existing BERT-based weakly supervised approaches that require a significant amount of training examples. When compared to the RoBERTa baselines, our best approach establishes state-of-the-art performance with a 7% improvement in Exact Match.


title: Moduli spaces of untwisted wild Riemann surfaces

abstract: We construct moduli stacks of wild Riemann surfaces in the (pure) untwisted case, for any complex reductive structure group, and we define the corresponding (pure) wild mapping class groups.


title: Faster Convergence for Transformer Fine-tuning with Line Search Methods

abstract: Recent works have shown that line search methods greatly increase performance of traditional stochastic gradient descent methods on a variety of datasets and architectures [1], [2]. In this work we succeed in extending line search methods to the novel and highly popular Transformer architecture and dataset domains in natural language processing. More specifically, we combine the Armijo line search with the Adam optimizer and extend it by subdividing the networks architecture into sensible units and perform the line search separately on these local units. Our optimization method outperforms the traditional Adam optimizer and achieves significant performance improvements for small data sets or small training budgets, while performing equal or better for other tested cases. Our work is publicly available as a python package, which provides a hyperparameter-free pytorch optimizer that is compatible with arbitrary network architectures.


title: CI-sequences and almost complete intersections

abstract: We study the Hilbert function and the graded Betti numbers of almost complete intersection artinian algebras. We show that that every Hilbert function of a complete intersection artinian algebra is the Hilbert function of an almost complete intersection algebra. In codimension $3$ we focus on almost complete intersection artinian algebras whose Hilbert function coincides with that of a complete intersection defined by $3$ forms of the same degree. We classify all the possible graded Betti numbers of such algebras and we specify what cancellations are allowed in a minimal graded free resolution.


title: On Propositional Dynamic Logic and Concurrency

abstract: Dynamic logic in the setting of concurrency has proved problematic because of the challenge of capturing interleaving. This challenge stems from the fact that the operational semantics for programs considered in these logics is tailored on trace reasoning for sequential programs. In this work, we generalise propositional dynamic logic (PDL) to a logic framework we call operational propositional dynamic logic (OPDL) in which we are able to reason on sets of programs provided with arbitrary operational semantics. We prove cut-elimination and adequacy of a sequent calculus for PDL and we extend these results to OPDL. We conclude by discussing OPDL for Milner's CCS and Choreographic Programming.


title: Distributed Maximum Consensus over Noisy Links

abstract: We introduce a distributed algorithm, termed noise-robust distributed maximum consensus (RD-MC), for estimating the maximum value within a multi-agent network in the presence of noisy communication links. Our approach entails redefining the maximum consensus problem as a distributed optimization problem, allowing a solution using the alternating direction method of multipliers. Unlike existing algorithms that rely on multiple sets of noise-corrupted estimates, RD-MC employs a single set, enhancing both robustness and efficiency. To further mitigate the effects of link noise and improve robustness, we apply moving averaging to the local estimates. Through extensive simulations, we demonstrate that RD-MC is significantly more robust to communication link noise compared to existing maximum-consensus algorithms.


title: Observation of vortices in a dipolar supersolid

abstract: Supersolids are states of matter that spontaneously break two continuous symmetries: translational invariance due to the appearance of a crystal structure and phase invariance due to phase locking of single-particle wave functions, responsible for superfluid phenomena. While originally predicted to be present in solid helium, ultracold quantum gases provided a first platform to observe supersolids, with particular success coming from dipolar atoms. Phase locking in dipolar supersolids has been probed through e.g. measurements of the phase coherence and gapless Goldstone modes, but quantized vortices, a hydrodynamic fingerprint of superfluidity, have not yet been observed. Here, with the prerequisite pieces at our disposal, namely a method to generate vortices in dipolar gases and supersolids with two-dimensional crystalline order, we report on the theoretical investigation and experimental observation of vortices in the supersolid phase. Our work reveals a fundamental difference in vortex seeding dynamics between unmodulated and modulated quantum fluids. This opens the door to study the hydrodynamic properties of exotic quantum systems with multiple spontaneously broken symmetries, in disparate domains such as quantum crystals and neutron stars.


title: Bolzano's Conjecture: Measuring the Numerosity of Infinite Sets

abstract: Bolzano and Cantor were the first mathematicians to make significant attempts to measure the size (numerosity) of different infinite collections. They differed in their methodological approaches, with Cantor's prevailing. This led to the foundation of the theory of sets as well as Cantor's transfinite arithmetic. This paper argues that Bolzano's conjecture is correct and that Euclid's principle, 'that the whole is greater than a part', should be considered as a necessary condition for the quantification of infinite sets (rather than bijection). Cantor had concluded that the rational and the algebraic numbers were of the same size as the natural numbers, whilst, in contrast, the real numbers were a larger set. Using Cantor's methods it is shown in this paper that the rational numbers are of larger size than the natural numbers, thus showing that bijection is not a reliable measure of the size of infinite sets. It is also concluded, using mathematical induction, that different 'countably' infinite sets can have various different sizes. The implications for theorems using bijection as a measure of size is then briefly discussed. There already exist new methods of measuring numerosity, based on Euclid's principle, which may develop a consistent system of infinite arithmetic.


title: ParCo: Part-Coordinating Text-to-Motion Synthesis

abstract: We study a challenging task: text-to-motion synthesis, aiming to generate motions that align with textual descriptions and exhibit coordinated movements. Currently, the part-based methods introduce part partition into the motion synthesis process to achieve finer-grained generation. However, these methods encounter challenges such as the lack of coordination between different part motions and difficulties for networks to understand part concepts. Moreover, introducing finer-grained part concepts poses computational complexity challenges. In this paper, we propose Part-Coordinating Text-to-Motion Synthesis (ParCo), endowed with enhanced capabilities for understanding part motions and communication among different part motion generators, ensuring a coordinated and fined-grained motion synthesis. Specifically, we discretize whole-body motion into multiple part motions to establish the prior concept of different parts. Afterward, we employ multiple lightweight generators designed to synthesize different part motions and coordinate them through our part coordination module. Our approach demonstrates superior performance on common benchmarks with economic computations, including HumanML3D and KIT-ML, providing substantial evidence of its effectiveness. Code is available at https://github.com/qrzou/ParCo .


title: Realizing temporal transportation trees

abstract: In this paper, we study the complexity of the \textit{periodic temporal graph realization} problem with respect to upper bounds on the fastest path durations among its vertices. This constraint with respect to upper bounds appears naturally in transportation network design applications where, for example, a road network is given, and the goal is to appropriately schedule periodic travel routes, while not exceeding some desired upper bounds on the travel times. This approach is in contrast to verification applications of the graph realization problems, where exact values for the distances (respectively, fastest travel times) are given, following some kind of precise measurement. In our work, we focus only on underlying tree topologies, which are fundamental in many transportation network applications. As it turns out, the periodic upper-bounded temporal tree realization problem (TTR) has a very different computational complexity behavior than both (i) the classic graph realization problem with respect to shortest path distances in static graphs and (ii) the periodic temporal graph realization problem with exact given fastest travel times (which was recently introduced). First, we prove that, surprisingly, TTR is NP-hard, even for a constant period $\Delta$ and when the input tree $G$ satisfies at least one of the following conditions: (a) $G$ has a constant diameter, or (b) $G$ has constant maximum degree. In contrast, when we are given exact values of the fastest travel delays, the problem is known to be solvable in polynomial time. Second, we prove that TTR is fixed-parameter tractable (FPT) with respect to the number of leaves in the input tree $G$, via a novel combination of techniques for totally unimodular matrices and mixed integer linear programming.


title: CT-3DFlow : Leveraging 3D Normalizing Flows for Unsupervised Detection of Pathological Pulmonary CT scans

abstract: Unsupervised pathology detection can be implemented by training a model on healthy data only and measuring the deviation from the training set upon inference, for example with CNN-based feature extraction and one-class classifiers, or reconstruction-score-based methods such as AEs, GANs and Diffusion models. Normalizing Flows (NF) have the ability to directly learn the probability distribution of training examples through an invertible architecture. We leverage this property in a novel 3D NF-based model named CT-3DFlow, specifically tailored for patient-level pulmonary pathology detection in chest CT data. Our model is trained unsupervised on healthy 3D pulmonary CT patches, and detects deviations from its log-likelihood distribution as anomalies. We aggregate patches-level likelihood values from a patient's CT scan to provide a patient-level 'normal'/'abnormal' prediction. Out-of-distribution detection performance is evaluated using expert annotations on a separate chest CT test dataset, outperforming other state-of-the-art methods.


title: Autonomous Quantum Heat Engine Based on Non-Markovian Dynamics of an Optomechanical Hamiltonian

abstract: We propose a recipe for demonstrating an autonomous quantum heat engine where the working fluid consists of a harmonic oscillator, the frequency of which is tuned by a driving mode. The working fluid is coupled two heat reservoirs each exhibiting a peaked power spectrum, a hot reservoir peaked at a higher frequency than the cold reservoir. Provided that the driving mode is initialized in a coherent state with a high enough amplitude and the parameters of the utilized optomechanical Hamiltonian and the reservoirs are appropriate, the driving mode induces an approximate Otto cycle for the working fluid and consequently its oscillation amplitude begins to increase in time. We build both an analytical and a non-Markovian quasiclassical model for this quantum heat engine and show that reasonably powerful coherent fields can be generated as the output of the quantum heat engine. This general theoretical proposal heralds the in-depth studies of quantum heat engines in the non-Markovian regime. Further, it paves the way for specific physical realizations, such as those in optomechanical systems, and for the subsequent experimental realization of an autonomous quantum heat engine.


title: Multi-View Deep Learning for Imaging Atmospheric Cherenkov Telescopes

abstract: This research note concerns the application of deep-learning-based multi-view-imaging techniques to data from the H.E.S.S. Imaging Atmospheric Cherenkov Telescope array. We find that the earlier the fusion of layer information from different views takes place in the neural network, the better our model performs with this data. Our analysis shows that the point in the network where the information from the different views is combined is far more important for the model performance than the method used to combine the information.


title: Efficient Algorithms for Regularized Nonnegative Scale-invariant Low-rank Approximation Models

abstract: Regularized nonnegative low-rank approximations such as sparse Nonnegative Matrix Factorization or sparse Nonnegative Tucker Decomposition are an important branch of dimensionality reduction models with enhanced interpretability. However, from a practical perspective, the choice of regularizers and regularization coefficients, as well as the design of efficient algorithms, is challenging because of the multifactor nature of these models and the lack of theory to back these choices. This paper aims at improving upon these issues. By studying a more general model called the Homogeneous Regularized Scale-Invariant, we prove that the scale-invariance inherent to low-rank approximation models causes an implicit regularization with both unexpected beneficial and detrimental effects. This observation allows to better understand the effect of regularization functions in low-rank approximation models, to guide the choice of the regularization hyperparameters, and to design balancing strategies to enhance the convergence speed of dedicated optimization algorithms. Some of these results were already known but restricted to specific instances of regularized low-rank approximations. We also derive a generic Majorization Minimization algorithm that handles many regularized nonnegative low-rank approximations, with convergence guarantees. We showcase our contributions on sparse Nonnegative Matrix Factorization, ridge-regularized Canonical Polyadic decomposition and sparse Nonnegative Tucker Decomposition.


title: Non-empirical prediction of the length-dependent ionization potential in molecular chains

abstract: The ionization potential of molecular chains is well-known to be a tunable nano-scale property that exhibits clear quantum confinement effects. State-of-the-art methods can accurately predict the ionization potential in the small molecule limit and in the solid-state limit, but for intermediate, nano-sized systems prediction of the evolution of the electronic structure between the two limits is more difficult. Recently, optimal tuning of range-separated hybrid functionals has emerged as a highly accurate method for predicting ionization potentials. This was first achieved for molecules using the ionization potential theorem (IPT) and more recently extended to solid-state systems, based on an \textit{ansatz} that generalizes the IPT to the removal of charge from a localized Wannier function. Here, we study one-dimensional molecular chains of increasing size, from the monomer limit to the infinite polymer limit using this approach. By comparing our results with other localization-based methods and where available with experiment, we demonstrate that Wannier-localization-based optimal tuning is highly accurate in predicting ionization potentials for any chain length, including the nano-scale regime.


title: Improving Line Search Methods for Large Scale Neural Network Training

abstract: In recent studies, line search methods have shown significant improvements in the performance of traditional stochastic gradient descent techniques, eliminating the need for a specific learning rate schedule. In this paper, we identify existing issues in state-of-the-art line search methods, propose enhancements, and rigorously evaluate their effectiveness. We test these methods on larger datasets and more complex data domains than before. Specifically, we improve the Armijo line search by integrating the momentum term from ADAM in its search direction, enabling efficient large-scale training, a task that was previously prone to failure using Armijo line search methods. Our optimization approach outperforms both the previous Armijo implementation and tuned learning rate schedules for Adam. Our evaluation focuses on Transformers and CNNs in the domains of NLP and image data. Our work is publicly available as a Python package, which provides a hyperparameter free Pytorch optimizer.


title: Global convergence of iterative solvers for problems of nonlinear magnetostatics

abstract: We consider the convergence of iterative solvers for problems of nonlinear magnetostatics. Using the equivalence to an underlying minimization problem, we can establish global linear convergence of a large class of methods, including the damped Newton-method, fixed-point iteration, and the Kacanov iteration, which can all be interpreted as generalized gradient descent methods. Armijo backtracking isconsidered for an adaptive choice of the stepsize. The general assumptions required for our analysis cover inhomogeneous, nonlinear, and anisotropic materials, as well as permanent magnets. The main results are proven on the continuous level, but they carry over almost verbatim to various approximation schemes, including finite elements and isogeometric analysis, leading to bounds on the iteration numbers, which are independent of the particular discretization. The theoretical results are illustrated by numerical tests for a typical benchmark problem.


title: Redirecting Flows -- Navigating the Future of the Amazon

abstract: The Amazon Basin and the Latin America and Caribbean (LAC) region stands at a critical juncture, grappling with pressing environmental challenges while holding immense potential for transformative change through innovative solutions. This report illuminates the diverse landscape of social-ecological issues, technological advancements, community-led initiatives, and strategic actions that could help foster biosphere-based sustainability and resilience across the region.


title: On the $A_\alpha$-index of graphs with given order and dissociation number

abstract: Given a graph $G,$ a subset of vertices is called a maximum dissociation set of $G$ if it induces a subgraph with vertex degree at most 1, and the subset has maximum cardinality. The cardinality of a maximum dissociation set is called the dissociation number of $G$. The adjacency matrix and the degree diagonal matrix of $G$ are denoted by $A(G)$ and $D(G),$ respectively. In 2017, Nikiforov proposed the $A_\alpha$-matrix: $A_\alpha(G)=\alpha D(G)+(1-\alpha)A(G),$ where $\alpha\in[0,1].$ The largest eigenvalue of this novel matrix is called the $A_\alpha$-index of $G.$ In this paper, we firstly determine the connected graph (resp. bipartite graph, tree) having the largest $A_\alpha$-index over all connected graphs (resp. bipartite graphs, trees) with fixed order and dissociation number. Secondly, we describe the structure of all the $n$-vertex graphs having the minimum $A_\alpha$-index with dissociation number $\tau$, where $\tau\geqslant\lceil\frac{2}{3}n\rceil.$ Finally, we identify all the connected $n$-vertex graphs with dissociation number $\tau\in\{2,\lceil\frac{2}{3}n\rceil,n-1,n-2\}$ having the minimum $A_\alpha$-index.


title: Exact Solution of Bipartite Fluctuations in One-Dimensional Fermions

abstract: Emergence of hydrodynamics in quantum many-body systems has recently garnered growing interest. The recent experiment of ultracold atoms [J. F. Wienand {\it et al.}, arXiv:2306.11457] studied emergent hydrodynamics in hard-core bosons using a bipartite fluctuation, which quantifies how the particle number fluctuates in a subsystem. In this Letter, we theoretically study the variance of a bipartite fluctuation in one-dimensional noninteracting fermionic dynamics starting from an alternating state, deriving the exact solution of the variance and its asymptotic linear growth law for the long-time dynamics. To compare the theoretical prediction with the experiment, we generalize our exact solution by incorporating the incompleteness of the initial alternating state, deriving the general linear growth law analytically. We find that it shows quantitative agreement with the experimentally observed variance growth without any fitting parameters.


title: Bridging the Gap: Regularized Reinforcement Learning for Improved Classical Motion Planning with Safety Modules

abstract: Classical navigation planners can provide safe navigation, albeit often suboptimally and with hindered human norm compliance. ML-based, contemporary autonomous navigation algorithms can imitate more natural and humancompliant navigation, but usually require large and realistic datasets and do not always provide safety guarantees. We present an approach that leverages a classical algorithm to guide reinforcement learning. This greatly improves the results and convergence rate of the underlying RL algorithm and requires no human-expert demonstrations to jump-start the process. Additionally, we incorporate a practical fallback system that can switch back to a classical planner to ensure safety. The outcome is a sample efficient ML approach for mobile navigation that builds on classical algorithms, improves them to ensure human compliance, and guarantees safety.


title: Language Plays a Pivotal Role in the Object-Attribute Compositional Generalization of CLIP

abstract: Vision-language models, such as CLIP, have shown promising Out-of-Distribution (OoD) generalization under various types of distribution shifts. Recent studies attempted to investigate the leading cause of this capability. In this work, we follow the same path, but focus on a specific type of OoD data - images with novel compositions of attribute-object pairs - and study whether such models can successfully classify those images into composition classes. We carefully designed an authentic image test dataset called ImageNet-AO, consisting of attributes for objects that are unlikely encountered in the CLIP training sets. We found that CLIPs trained with large datasets such as OpenAI CLIP, LAION-400M, and LAION-2B show orders-of-magnitude improvement in effective compositional OoD generalization compared to both supervised models and CLIPs trained with smaller datasets, such as CC-12M and YFCC-15M. Our results provide evidence that the scale and diversity of training data and language supervision play a key role in unlocking the compositional generalization abilities of vision-language models.


title: Number of aftershocks in epidemic-type seismicity models

abstract: Let $V_M,(m_0)$ be the number of m>M aftershocks caused by $m_0$ event. We consider the $V_M,(m_0)$ distribution within epidemic-type seismicity models, ETAS(F). These models include the Gutenberg-Richter law for magnitude and Utsu law for average productivity of m0, but differ in the type of F distribution for the number v(m0) of direct aftershocks. The class of F is quite broad and includes both the Poisson distribution, which is the basis for the regular ETAS model, and its possible alternative, the Geometric distribution. Instead of the traditional threshold $M=m_0-\Delta$, we consider $M=m_a-\Delta$, where $m_a$ is the mode in the distribution of the strongest aftershock. Under these conditions we find the limit $V_M,(m_0)$ distribution at $m_0\gg1$. In the subcritical case, the limit distribution is extremely simple and identical to the $v(m_\Delta)$ distribution with a suitable magnitude $m=m_\Delta$. Theoretical results of this kind are lacking even for the regular ETAS model. Our results provide an additional opportunity to test the type of F-distribution, Bath law, and the very concept of epidemic-type clustering.


title: Wirtinger gradient descent methods for low-dose Poisson phase retrieval

abstract: The problem of phase retrieval has many applications in the field of optical imaging. Motivated by imaging experiments with biological specimens, we primarily consider the setting of low-dose illumination where Poisson noise plays the dominant role. In this paper, we discuss gradient descent algorithms based on different loss functions adapted to data affected by Poisson noise, in particular in the low-dose regime. Starting from the maximum log-likelihood function for the Poisson distribution, we investigate different regularizations and approximations of the problem to design an algorithm that meets the requirements that are faced in applications. In the course of this, we focus on low-count measurements. For all suggested loss functions, we study the convergence of the respective gradient descent algorithms to stationary points and find constant step sizes that guarantee descent of the loss in each iteration. Numerical experiments in the low-dose regime are performed to corroborate the theoretical observations.


title: Limited Attention Allocation in a Stochastic Linear Quadratic System with Multiplicative Noise

abstract: This study addresses limited attention allocation in a stochastic linear quadratic system with multiplicative noise. Our approach enables strategic resource allocation to enhance noise estimation and improve control decisions. We provide analytical optimal control and propose a numerical method for optimal attention allocation. Additionally, we apply our ffndings to dynamic mean-variance portfolio selection, showing effective resource allocation across time periods and factors, providing valuable insights for investors.


title: Velocity Distribution of Dark Matter Spike around Schwarzschild Black Holes and Effects on Gravitational Waves from EMRIs

abstract: Dark matter (DM) constitutes the predominant portion of matter in our universe. Despite compelling evidence, the precise characteristics of DM remain elusive. Among the leading DM candidates are weakly interacting massive particles, which may aggregate into steep concentrations around the central black holes of galaxies, forming dense spikes. Employing Schwarzschild geometry, we assess the density and velocity distribution of DM within such spikes. Through variations in black hole masses and dark halo parameters, we identify universal features in the density profile of DM and fit them with Gaussian distributions. Additionally, we investigate the impact of dynamical friction on gravitational waves (GWs) generated by extreme-mass-ratio inspirals (EMRIs) within DM spikes. Our findings uncover phase shifts in the time-domain waveform, potentially providing significant insights for the GW-based detection of DM in galactic centers.


title: The SZ effect with anisotropic distributions and high energy electrons

abstract: Future observations of the Sunyaev-Zeldovich (SZ) effect promise ever improving measurements in terms of both sensitivity and angular resolution. As such, it is increasingly relevant to model `higher-order' contributions to the SZ effect. This work examines the effects of high-energy non-thermal electron distributions and those of anisotropic electron and photon distributions on the SZ signals. Analytic forms of the anisotropic scattering kernels for photons and electrons have been derived and investigated. We present a method for determining the anisotropic contributions through a spherical harmonic decomposition to arbitrary angular multipoles, and discuss the behaviour of these scattering kernels. We then carry out an exploration of various simplistic models of high energy non-thermal electron distributions, and examine their anisotropic behaviour. The kinematic SZ in the relativistic regime is studied using the kernel formulation allowing us to clarifying the role of kinematic corrections to the scattering optical depth. We finally present a release of an updated and refined version of SZpack including a new integrated Python interface and new modules for the calculation of various SZ signals, including those described in this paper.


title: Methods for fast and accurate material properties estimate with terahertz time-domain spectroscopy in transmission and reflection with optically thick materials

abstract: With the development of terahertz time-domain spectroscopy, methods have been proposed to precisely estimate the thickness, refractive index, and attenuation coefficient of a sample. In this article, we propose a new method to compute these parameters. In this method, the attenuation is expressed in function of the refractive index. The theoretical unwrapped angle, which therefore only depends on the refractive index, is then matched to the experimental value. By applying already existing methods for estimating the thickness of an optically thick sample, the dielectric properties of the sample can be deduced. The method is applied both to the transmission and reflection spectroscopy. A demonstration of the method and a comparison with the previous methods are finally shown.


title: Scaling limits for random walks on long range percolation clusters

abstract: We study limit laws for simple random walks on supercritical long-range percolation clusters on the integer lattice. For the long range percolation model, the probability that two vertices are connected behaves asymptotically as a negative power of distance between them. We prove that the scaling limit of simple random walk on the infinite component converges to an isotropic alpha-stable Levy process. This complements the work of Crawford and Sly, who proved the corresponding result for alpha between 0 and 1. The convergence holds in both the quenched and annealed senses.


title: Innermost stable circular orbits around a spinning black hole binary

abstract: Using the exact solution that describes multi-centered rotating black holes, recently discovered by Teo and Wan, we investigate the innermost stable circular orbit (ISCO) for massive particles and the circular orbit for massless particles moving around a spinning black hole binary. We assume equal masses $M_1 = M_2=m$ and equal spin angular momenta $|J_1| = |J_2|$ for both black holes. Firstly, we examine the case where two black holes are spinning in the same direction ($J_1=J_2$). We clarify that that for particles rotating in the same direction as (opposite directions to) black holes' spin, the greater the spin angular momenta of the black holes, the more the radii of the ISCO for massive particles and the circular orbit for massless particles decrease (increase). We show that distinct ISCO transitions occur for particles rotating in the same direction as the black holes in three ranges of spin angular momenta: $0<J_1/m^2=J_2/m^2< 0.395...$, $0.395...<J_1/m^2=J_2/m^2< 0.483...$, and $0.483...<J_1/m^2=J_2/m^2<0.5$. Conversely, particles rotating in the opposite direction to the black holes exhibit a consistent transition pattern for the case $0<J_1/m^2=J_2/m^2<0.5$. Secondly, we study the situation where binary black holes are spinning in opposite directions ($J_1=-J_2$). We clarify that for large (small) separations between black holes, the ISCO appears near the black hole that is spinning in the same (opposite) direction as particles' rotation. Additionally, we show that different ISCO transitions occur in the three angular momentum ranges: $0<J_1/m^2=-J_2/m^2< 0.160...$, $0.160...<J_1/m^2=-J_2/m^2< 0.467...$, and $0.467...<J_1/m^2=-J_2/m^2<0.5$.


title: Creating spanning trees in Waiter-Client games

abstract: For a positive integer $n$ and a tree $T_n$ on $n$ vertices, we consider an unbiased Waiter-Client game $\textrm{WC}(n,T_n)$ played on the complete graph~$K_n$, in which Waiter's goal is to force Client to build a copy of $T_n$. We prove that for every constant $c<1/3$, if $\Delta(T_n)\le cn$ and $n$ is sufficiently large, then Waiter has a winning strategy in $\textrm{WC}(n,T_n)$. On the other hand, we show that there exist a positive constant $c'<1/2$ and a family of trees $T_{n}$ with $\Delta(T_n)\le c'n$ such that Client has a winning strategy in the $\textrm{WC}(n,T_n)$ game for every $n$ sufficiently large. We also consider the corresponding problem in the Client-Waiter version of the game.


title: Theoretical Bound-Guided Hierarchical VAE for Neural Image Codecs

abstract: Recent studies reveal a significant theoretical link between variational autoencoders (VAEs) and rate-distortion theory, notably in utilizing VAEs to estimate the theoretical upper bound of the information rate-distortion function of images. Such estimated theoretical bounds substantially exceed the performance of existing neural image codecs (NICs). To narrow this gap, we propose a theoretical bound-guided hierarchical VAE (BG-VAE) for NIC. The proposed BG-VAE leverages the theoretical bound to guide the NIC model towards enhanced performance. We implement the BG-VAE using Hierarchical VAEs and demonstrate its effectiveness through extensive experiments. Along with advanced neural network blocks, we provide a versatile, variable-rate NIC that outperforms existing methods when considering both rate-distortion performance and computational complexity. The code is available at BG-VAE.


title: A Novel Behavior-Based Recommendation System for E-commerce

abstract: The majority of existing recommender systems rely on user ratings, which are limited by the lack of user collaboration and the sparsity problem. To address these issues, this study proposes a behavior-based recommender system that leverages customers' natural behaviors, such as browsing and clicking, on e-commerce platforms. The proposed recommendation system involves clustering active customers, determining neighborhoods, collecting similar users, calculating product reputation based on similar users, and recommending high-reputation products. To overcome the complexity of customer behaviors and traditional clustering methods, an unsupervised clustering approach based on product categories is developed to enhance the recommendation methodology. This study makes notable contributions in several aspects. Firstly, a groundbreaking behavior-based recommendation methodology is developed, incorporating customer behavior to generate accurate and tailored recommendations leading to improved customer satisfaction and engagement. Secondly, an original unsupervised clustering method, focusing on product categories, enables more precise clustering and facilitates accurate recommendations. Finally, an approach to determine neighborhoods for active customers within clusters is established, ensuring grouping of customers with similar behavioral patterns to enhance recommendation accuracy and relevance. The proposed recommendation methodology and clustering method contribute to improved recommendation performance, offering valuable insights for researchers and practitioners in the field of e-commerce recommendation systems. Additionally, the proposed method outperforms benchmark methods in experiments conducted using a behavior dataset from the well-known e-commerce site Alibaba.


title: A Path Towards Legal Autonomy: An interoperable and explainable approach to extracting, transforming, loading and computing legal information using large language models, expert systems and Bayesian networks

abstract: Legal autonomy - the lawful activity of artificial intelligence agents - can be achieved in one of two ways. It can be achieved either by imposing constraints on AI actors such as developers, deployers and users, and on AI resources such as data, or by imposing constraints on the range and scope of the impact that AI agents can have on the environment. The latter approach involves encoding extant rules concerning AI driven devices into the software of AI agents controlling those devices (e.g., encoding rules about limitations on zones of operations into the agent software of an autonomous drone device). This is a challenge since the effectivity of such an approach requires a method of extracting, loading, transforming and computing legal information that would be both explainable and legally interoperable, and that would enable AI agents to reason about the law. In this paper, we sketch a proof of principle for such a method using large language models (LLMs), expert legal systems known as legal decision paths, and Bayesian networks. We then show how the proposed method could be applied to extant regulation in matters of autonomous cars, such as the California Vehicle Code.


title: Uphill drift in the absence of current in single-file diffusion

abstract: Single-file diffusion is a paradigmatic model for the transport of Brownian colloidal particles in narrow one-dimensional channels, such as those found in certain porous media, where the particles cannot cross each other. We consider a system where a different external uniform potential is present to the right and left of an origin. For example, this is the case when two channels meeting at the origin have different radii. In equilibrium, the chemical potential of the particles are equal, the density is thus lower in the region with the higher potential, and by definition there is no net current in the system. Remarkably, a single-file tracer particle initially located at the origin, with position denoted by $Y(t)$, exhibits an average {\em up-hill} drift toward the region of {\em highest} potential. This drift has the late time behavior $\langle Y(t)\rangle= C t^{1/4}$, where the prefactor $C$ depends on the initial particle arrangement. This surprising result is shown analytically by computing the first two moments of $Y(t)$ through a simple and physically-illuminating method, and also via extensive numerical simulations.


title: Safe and Robust Reinforcement Learning: Principles and Practice

abstract: Reinforcement Learning (RL) has shown remarkable success in solving relatively complex tasks, yet the deployment of RL systems in real-world scenarios poses significant challenges related to safety and robustness. This paper aims to identify and further understand those challenges thorough the exploration of the main dimensions of the safe and robust RL landscape, encompassing algorithmic, ethical, and practical considerations. We conduct a comprehensive review of methodologies and open problems that summarizes the efforts in recent years to address the inherent risks associated with RL applications. After discussing and proposing definitions for both safe and robust RL, the paper categorizes existing research works into different algorithmic approaches that enhance the safety and robustness of RL agents. We examine techniques such as uncertainty estimation, optimisation methodologies, exploration-exploitation trade-offs, and adversarial training. Environmental factors, including sim-to-real transfer and domain adaptation, are also scrutinized to understand how RL systems can adapt to diverse and dynamic surroundings. Moreover, human involvement is an integral ingredient of the analysis, acknowledging the broad set of roles that humans can take in this context. Importantly, to aid practitioners in navigating the complexities of safe and robust RL implementation, this paper introduces a practical checklist derived from the synthesized literature. The checklist encompasses critical aspects of algorithm design, training environment considerations, and ethical guidelines. It will serve as a resource for developers and policymakers alike to ensure the responsible deployment of RL systems in many application domains.


title: skscope: Fast Sparsity-Constrained Optimization in Python

abstract: Applying iterative solvers on sparsity-constrained optimization (SCO) requires tedious mathematical deduction and careful programming/debugging that hinders these solvers' broad impact. In the paper, the library skscope is introduced to overcome such an obstacle. With skscope, users can solve the SCO by just programming the objective function. The convenience of skscope is demonstrated through two examples in the paper, where sparse linear regression and trend filtering are addressed with just four lines of code. More importantly, skscope's efficient implementation allows state-of-the-art solvers to quickly attain the sparse solution regardless of the high dimensionality of parameter space. Numerical experiments reveal the available solvers in skscope can achieve up to 80x speedup on the competing relaxation solutions obtained via the benchmarked convex solver. skscope is published on the Python Package Index (PyPI) and Conda, and its source code is available at: https://github.com/abess-team/skscope.


title: Thin accretion disk and shadow of Kerr-Sen black hole in Einstein-Maxwell-dilaton-axion gravity

abstract: We investigate the accretion process in a thin disk surrounding a supermassive black hole in Einstein-Maxwell-dilaton-axion (EMDA) gravity by using the Novikov-Thorne model. The results reveal that as the dilaton parameter $r_2$ increase, the energy flux, radiation temperature, spectra luminosity, and radiative efficiency of the disk all increases. By narrowing down the dilaton parameter range to $0\leqslant \frac{r_2}{M}\leqslant0.4$, we discover that in the high-frequency region, the Kerr-Sen black hole demonstrates higher energy output compared to the Kerr black hole. We also investigated the Kerr-Sen black hole shadow in a uniform plasma environment. For a fixed inclination angle of $\theta_0=90^\circ$, $\frac{r_2}{M} = \frac{a}{M} = 0.5$, the shadow increase as the homogeneous plasma parameter $k$ increase. Conversely, when $k = 0.1$ and $\frac{a}{M} = 0.5$, an increase in $r_2$ leads to a decrease in the shadow. Furthermore, by using observational data from M87* and Sgr A*, we compared the theoretical and observed shadow diameters to constrain the range of the model parameters.


title: Attention-aware semantic relevance predicting Chinese sentence reading

abstract: In recent years, several influential computational models and metrics have been proposed to predict how humans comprehend and process sentence. One particularly promising approach is contextual semantic similarity. Inspired by the attention algorithm in Transformer and human memory mechanisms, this study proposes an ``attention-aware'' approach for computing contextual semantic relevance. This new approach takes into account the different contributions of contextual parts and the expectation effect, allowing it to incorporate contextual information fully. The attention-aware approach also facilitates the simulation of existing reading models and evaluate them. The resulting ``attention-aware'' metrics of semantic relevance can more accurately predict fixation durations in Chinese reading tasks recorded in an eye-tracking corpus than those calculated by existing approaches. The study's findings further provide strong support for the presence of semantic preview benefits in Chinese naturalistic reading. Furthermore, the attention-aware metrics of semantic relevance, being memory-based, possess high interpretability from both linguistic and cognitive standpoints, making them a valuable computational tool for modeling eye-movements in reading and further gaining insight into the process of language comprehension. Our approach underscores the potential of these metrics to advance our comprehension of how humans understand and process language, ultimately leading to a better understanding of language comprehension and processing.


title: Accurate analytical modeling of light rays in spherically symmetric spacetimes: Applications in the study of black hole accretion disks and polarimetry

abstract: We present new, simple analytical formulas to accurately describe light rays in spherically symmetric static spacetimes. These formulas extend those introduced by Beloborodov and refined by Poutanen for the Schwarzschild metric. Our enhanced formulas are designed to be applicable to a broader range of spacetimes, making them particularly valuable for describing phenomena around compact objects like neutron stars and black holes. As an illustration of their application, we present analytical studies of images of thin accretion disks surrounding black holes and explore their associated polarimetry.


title: On the distribution of the components of multicurves of given type

abstract: We study the distribution of the individual components of a random multicurve under the action of the mapping class group.


title: Optimal Resource Efficiency with Fairness in Heterogeneous GPU Clusters

abstract: Ensuring the highest training throughput to maximize resource efficiency, while maintaining fairness among users, is critical for deep learning (DL) training in heterogeneous GPU clusters. However, current DL schedulers provide only limited fairness properties and suboptimal training throughput, impeding tenants from effectively leveraging heterogeneous resources. The underlying design challenge stems from inherent conflicts between efficiency and fairness properties. In this paper, we introduce OEF, a new resource allocation framework specifically developed for achieving optimal resource efficiency and ensuring diverse fairness properties in heterogeneous GPU clusters. By integrating resource efficiency and fairness within a global optimization framework, OEF is capable of providing users with maximized overall efficiency, as well as various guarantees of fairness, in both cooperative and non-cooperative environments. We have implemented OEF in a cluster resource manager and conducted large-scale experiments, showing that OEF can improve the overall training throughput by up to 32% while improving fairness compared to state-of-the-art heterogeneity-aware schedulers.


title: Efficient Heatmap-Guided 6-Dof Grasp Detection in Cluttered Scenes

abstract: Fast and robust object grasping in clutter is a crucial component of robotics. Most current works resort to the whole observed point cloud for 6-Dof grasp generation, ignoring the guidance information excavated from global semantics, thus limiting high-quality grasp generation and real-time performance. In this work, we show that the widely used heatmaps are underestimated in the efficiency of 6-Dof grasp generation. Therefore, we propose an effective local grasp generator combined with grasp heatmaps as guidance, which infers in a global-to-local semantic-to-point way. Specifically, Gaussian encoding and the grid-based strategy are applied to predict grasp heatmaps as guidance to aggregate local points into graspable regions and provide global semantic information. Further, a novel non-uniform anchor sampling mechanism is designed to improve grasp accuracy and diversity. Benefiting from the high-efficiency encoding in the image space and focusing on points in local graspable regions, our framework can perform high-quality grasp detection in real-time and achieve state-of-the-art results. In addition, real robot experiments demonstrate the effectiveness of our method with a success rate of 94% and a clutter completion rate of 100%. Our code is available at https://github.com/THU-VCLab/HGGD.


title: Neural Architecture Search for Sentence Classification with BERT

abstract: Pre training of language models on large text corpora is common practice in Natural Language Processing. Following, fine tuning of these models is performed to achieve the best results on a variety of tasks. In this paper we question the common practice of only adding a single output layer as a classification head on top of the network. We perform an AutoML search to find architectures that outperform the current single layer at only a small compute cost. We validate our classification architecture on a variety of NLP benchmarks from the GLUE dataset.


title: A Semi-supervised Nighttime Dehazing Baseline with Spatial-Frequency Aware and Realistic Brightness Constraint

abstract: Existing research based on deep learning has extensively explored the problem of daytime image dehazing. However, few studies have considered the characteristics of nighttime hazy scenes. There are two distinctions between nighttime and daytime haze. First, there may be multiple active colored light sources with lower illumination intensity in nighttime scenes, which may cause haze, glow and noise with localized, coupled and frequency inconsistent characteristics. Second, due to the domain discrepancy between simulated and real-world data, unrealistic brightness may occur when applying a dehazing model trained on simulated data to real-world data. To address the above two issues, we propose a semi-supervised model for real-world nighttime dehazing. First, the spatial attention and frequency spectrum filtering are implemented as a spatial-frequency domain information interaction module to handle the first issue. Second, a pseudo-label-based retraining strategy and a local window-based brightness loss for semi-supervised training process is designed to suppress haze and glow while achieving realistic brightness. Experiments on public benchmarks validate the effectiveness of the proposed method and its superiority over state-of-the-art methods. The source code and Supplementary Materials are placed in the https://github.com/Xiaofeng-life/SFSNiD.


title: A communication-efficient, online changepoint detection method for monitoring distributed sensor networks

abstract: We consider the challenge of efficiently detecting changes within a network of sensors, where we also need to minimise communication between sensors and the cloud. We propose an online, communication-efficient method to detect such changes. The procedure works by performing likelihood ratio tests at each time point, and two thresholds are chosen to filter unimportant test statistics and make decisions based on the aggregated test statistics respectively. We provide asymptotic theory concerning consistency and the asymptotic distribution if there are no changes. Simulation results suggest that our method can achieve similar performance to the idealised setting, where we have no constraints on communication between sensors, but substantially reduce the transmission costs.