title: Data-Driven Deep Supervision for Skin Lesion Classification

abstract: Automatic classification of pigmented, non-pigmented, and depigmented non-melanocytic skin lesions have garnered lots of attention in recent years. However, imaging variations in skin texture, lesion shape, depigmentation contrast, lighting condition, etc. hinder robust feature extraction, affecting classification accuracy. In this paper, we propose a new deep neural network that exploits input data for robust feature extraction. Specifically, we analyze the convolutional network's behavior (field-of-view) to find the location of deep supervision for improved feature extraction. To achieve this, first, we perform activation mapping to generate an object mask, highlighting the input regions most critical for classification output generation. Then the network layer whose layer-wise effective receptive field matches the approximated object shape in the object mask is selected as our focus for deep supervision. Utilizing different types of convolutional feature extractors and classifiers on three melanoma detection datasets and two vitiligo detection datasets, we verify the effectiveness of our new method.


title: Hybrid mixed discontinuous Galerkin finite element method for incompressible wormhole propagation problem

abstract: Wormhole propagation plays a very important role in the product enhancement of oil and gas reservoir. A new combined hybrid mixed finite element method is proposed to solve incompressible wormhole propagation problem with discontinuous Galerkin finite element procedure, in which, the new hybrid mixed finite element algorithm is established for pressure equation, while the discontinuous Galerkin finite element method is considered for concentration equation, and then the porosity function is computed straightly by the approximate value of the concentration. This new combined method can keep local mass balance, meantime it also keeps the boundedness of the porosity. The convergence of the proposed method is analyzed and the optimal error estimate is derived. Finally, numerical examples are presented to verify the validity of the algorithm and the correctness of the theoretical results.


title: Affine geometric description of thermodynamics

abstract: Thermodynamics provides a unified perspective of thermodynamic properties of various substances. To formulate thermodynamics in the language of sophisticated mathematics, thermodynamics is described by a variety of differential geometries, including contact and symplectic geometries. Meanwhile affine geometry is a branch of differential geometry and is compatible with information geometry, where information geometry is known to be compatible with thermodynamics. By combining above, it is expected that thermodynamics is compatible with affine geometry, and is expected that several affine geometric tools can be introduced in the analysis of thermodynamic systems. In this paper affine geometric descriptions of equilibrium and nonequilibrium thermodynamics are proposed. For equilibrium systems, it is shown that several thermodynamic quantities can be identified with geometric objects in affine geometry, and that several geometric objects can be introduced in thermodynamics. Examples of these include: specific heat is identified with the affine fundamental form, a flat connection is introduced in thermodynamic phase space. For nonequilibrium systems, two classes of relaxation processes are shown to be described in the language of an extension of affine geometry. Finally this affine geometric description of thermodynamics for equilibrium and nonequilibrium systems is compared with a contact geometric description.


title: Informative Language Representation Learning for Massively Multilingual Neural Machine Translation

abstract: In a multilingual neural machine translation model that fully shares parameters across all languages, an artificial language token is usually used to guide translation into the desired target language. However, recent studies show that prepending language tokens sometimes fails to navigate the multilingual neural machine translation models into right translation directions, especially on zero-shot translation. To mitigate this issue, we propose two methods, language embedding embodiment and language-aware multi-head attention, to learn informative language representations to channel translation into right directions. The former embodies language embeddings into different critical switching points along the information flow from the source to the target, aiming at amplifying translation direction guiding signals. The latter exploits a matrix, instead of a vector, to represent a language in the continuous space. The matrix is chunked into multiple heads so as to learn language representations in multiple subspaces. Experiment results on two datasets for massively multilingual neural machine translation demonstrate that language-aware multi-head attention benefits both supervised and zero-shot translation and significantly alleviates the off-target translation issue. Further linguistic typology prediction experiments show that matrix-based language representations learned by our methods are capable of capturing rich linguistic typology features.


title: A scheme to create and verify scalable entanglement in optical lattice

abstract: To achieve scalable quantum information processing, great efforts have been devoted to the creation of large-scale entangled states in various physical systems. Ultracold atom in optical lattice is considered as one of the promising platforms due to its feasible initialization and parallel manipulation. In this work, we propose an efficient scheme to generate and characterize global entanglement in the optical lattice. With only two-layer quantum circuits, the generation utilizes two-qubit entangling gates based on the superexchange interaction in double wells. The parallelism of these operations enables the generation to be fast and scalable. To verify the entanglement of this non-stabilizer state, we mainly design three complementary detection protocols which are less resource-consuming compared to the full tomography. In particular, one just needs two homogenous local measurement settings to identify the entanglement property. Our entanglement generation and verification protocols provide the foundation for the further quantum information processing in optical lattice.


title: Distributed Coverage Control of Multi-Agent Systems with Load Balancing in Non-convex Environments

abstract: It is always a challenging task to service sudden events in non-convex and uncertain environments, and multi-agent coverage control provides a powerful theoretical framework to investigate the deployment problem of mobile robotic networks for minimizing the cost of handling random events. Inspired by the divide-and-conquer methodology, this paper proposes a novel coverage formulation to control multi-agent systems in the non-convex region while equalizing the workload among subregions. Thereby, a distributed coverage controller is designed to drive each agent towards the desired configurations that minimize the service cost by integrating with the rotational partition strategy. In addition, a circular search algorithm is proposed to identify optimal solutions to the problem of lowering service cost. Moreover, it is proved that this search algorithm enables to approximate the optimal configuration of multi-agent systems with the arbitrary small tolerance. Finally, numerical simulations are implemented to substantiate the efficacy of proposed coverage control approach.


title: Electrically driven compact hybrid lithium niobate microring laser

abstract: We demonstrate an electrically driven compact hybrid lithium niobate microring laser by butt coupling a commercial 980-nm pump laser diode chip with a high quality Er3+-doped lithium niobate microring chip. Single mode lasing emission at 1531 nm wavelength from the Er3+-doped lithium niobate microring can be observed with the integrated 980-nm laser pumping. The compact hybrid lithium niobate microring laser occupies the chip size of 3 mmx4mmx0.5 mm. The threshold pumping laser power is 6 mW and the threshold current is 0.5 A (operating voltage 1.64 V) in the atmospheric temperature. The spectrum featuring single mode lasing with small linewidth of 0.05 nm is observed. This work explores a robust hybrid lithium niobate microring laser source which has potential applications in coherent optical communication and precision metrology.


title: Multi-modal Masked Autoencoders Learn Compositional Histopathological Representations

abstract: Self-supervised learning (SSL) enables learning useful inductive biases through utilizing pretext tasks that require no labels. The unlabeled nature of SSL makes it especially important for whole slide histopathological images (WSIs), where patch-level human annotation is difficult. Masked Autoencoders (MAE) is a recent SSL method suitable for digital pathology as it does not require negative sampling and requires little to no data augmentations. However, the domain shift between natural images and digital pathology images requires further research in designing MAE for patch-level WSIs. In this paper, we investigate several design choices for MAE in histopathology. Furthermore, we introduce a multi-modal MAE (MMAE) that leverages the specific compositionality of Hematoxylin & Eosin (H&E) stained WSIs. We performed our experiments on the public patch-level dataset NCT-CRC-HE-100K. The results show that the MMAE architecture outperforms supervised baselines and other state-of-the-art SSL techniques for an eight-class tissue phenotyping task, utilizing only 100 labeled samples for fine-tuning. Our code is available at https://github.com/wisdomikezogwo/MMAE_Pathology


title: Simulation-Assisted Optimization for Large-Scale Evacuation Planning with Congestion-Dependent Delays

abstract: Evacuation planning is a crucial part of disaster management. However, joint optimization of its two essential components, routing and scheduling, with objectives such as minimizing average evacuation time or evacuation completion time, is a computationally hard problem. To approach it, we present MIP-LNS, a scalable optimization method that utilizes heuristic search with mathematical optimization and can optimize a variety of objective functions. We also present the method MIP-LNS-SIM, where we combine agent-based simulation with MIP-LNS to estimate delays due to congestion, as well as, find optimized plans considering such delays. We use Harris County in Houston, Texas, as our study area. We show that, within a given time limit, MIP-LNS finds better solutions than existing methods in terms of three different metrics. However, when congestion dependent delay is considered, MIP-LNS-SIM outperforms MIP-LNS in multiple performance metrics. In addition, MIP-LNS-SIM has a significantly lower percent error in estimated evacuation completion time compared to MIP-LNS.


title: Interpretable Fake News Detection with Topic and Deep Variational Models

abstract: The growing societal dependence on social media and user generated content for news and information has increased the influence of unreliable sources and fake content, which muddles public discourse and lessens trust in the media. Validating the credibility of such information is a difficult task that is susceptible to confirmation bias, leading to the development of algorithmic techniques to distinguish between fake and real news. However, most existing methods are challenging to interpret, making it difficult to establish trust in predictions, and make assumptions that are unrealistic in many real-world scenarios, e.g., the availability of audiovisual features or provenance. In this work, we focus on fake news detection of textual content using interpretable features and methods. In particular, we have developed a deep probabilistic model that integrates a dense representation of textual news using a variational autoencoder and bi-directional Long Short-Term Memory (LSTM) networks with semantic topic-related features inferred from a Bayesian admixture model. Extensive experimental studies with 3 real-world datasets demonstrate that our model achieves comparable performance to state-of-the-art competing models while facilitating model interpretability from the learned topics. Finally, we have conducted model ablation studies to justify the effectiveness and accuracy of integrating neural embeddings and topic features both quantitatively by evaluating performance and qualitatively through separability in lower dimensional embeddings.


title: TEM at Millikelvin Temperatures: Observing and Utilizing Superconducting Qubits

abstract: We present a case for developing a millikelvin-temperature transmission electron microscope (TEM). We start by reviewing known reasons for such development, then present new possibilities that have been opened up by recent progress in superconducting quantum circuitry, and finally report on our ongoing experimental effort. Specifically, we first review possibilities to observe a quantum mechanically superposed electromagnetic field around a superconducting qubit. This is followed by a new idea on TEM observation of microwave photons in an unusual quantum state in a resonator. We then proceed to review potential applications of these phenomena, which include low dose electron microscopy beyond the standard quantum limit. Finally, anticipated engineering challenges, as well as the authors' current ongoing experimental effort towards building a millikelvin TEM are described. In addition, we provide a brief introduction to superconducting circuitry in the Appendix for the interested reader who is not familiar with the subject.


abstract: Auditing Data Provenance (ADP), i.e., auditing if a certain piece of data has been used to train a machine learning model, is an important problem in data provenance. The feasibility of the task has been demonstrated by existing auditing techniques, e.g., shadow auditing methods, under certain conditions such as the availability of label information and the knowledge of training protocols for the target model. Unfortunately, both of these conditions are often unavailable in real applications. In this paper, we introduce Data Provenance via Differential Auditing (DPDA), a practical framework for auditing data provenance with a different approach based on statistically significant differentials, i.e., after carefully designed transformation, perturbed input data from the target model's training set would result in much more drastic changes in the output than those from the model's non-training set. This framework allows auditors to distinguish training data from non-training ones without the need of training any shadow models with the help of labeled output data. Furthermore, we propose two effective auditing function implementations, an additive one and a multiplicative one. We report evaluations on real-world data sets demonstrating the effectiveness of our proposed auditing technique.


title: Cross-Network Social User Embedding with Hybrid Differential Privacy Guarantees

abstract: Integrating multiple online social networks (OSNs) has important implications for many downstream social mining tasks, such as user preference modelling, recommendation, and link prediction. However, it is unfortunately accompanied by growing privacy concerns about leaking sensitive user information. How to fully utilize the data from different online social networks while preserving user privacy remains largely unsolved. To this end, we propose a Cross-network Social User Embedding framework, namely DP-CroSUE, to learn the comprehensive representations of users in a privacy-preserving way. We jointly consider information from partially aligned social networks with differential privacy guarantees. In particular, for each heterogeneous social network, we first introduce a hybrid differential privacy notion to capture the variation of privacy expectations for heterogeneous data types. Next, to find user linkages across social networks, we make unsupervised user embedding-based alignment in which the user embeddings are achieved by the heterogeneous network embedding technology. To further enhance user embeddings, a novel cross-network GCN embedding model is designed to transfer knowledge across networks through those aligned users. Extensive experiments on three real-world datasets demonstrate that our approach makes a significant improvement on user interest prediction tasks as well as defending user attribute inference attacks from embedding.


title: An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling

abstract: Masked visual modeling (MVM) has been recently proven effective for visual pre-training. While similar reconstructive objectives on video inputs (e.g., masked frame modeling) have been explored in video-language (VidL) pre-training, previous studies fail to find a truly effective MVM strategy that can largely benefit the downstream performance. In this work, we systematically examine the potential of MVM in the context of VidL learning. Specifically, we base our study on a fully end-to-end VIdeO-LanguagE Transformer (VIOLET), where the supervision from MVM training can be backpropagated to the video pixel space. In total, eight different reconstructive targets of MVM are explored, from low-level pixel values and oriented gradients to high-level depth maps, optical flow, discrete visual tokens, and latent visual features. We conduct comprehensive experiments and provide insights into the factors leading to effective MVM training, resulting in an enhanced model VIOLETv2. Empirically, we show VIOLETv2 pre-trained with MVM objective achieves notable improvements on 13 VidL benchmarks, ranging from video question answering, video captioning, to text-to-video retrieval.


title: InviCloak: An End-to-End Approach to Privacy and Performance in Web Content Distribution

abstract: In today's web ecosystem, a website that uses a Content Delivery Network (CDN) shares its Transport Layer Security (TLS) private key or session key with the CDN. In this paper, we present the design and implementation of InviCloak, a system that protects the confidentiality and integrity of a user and a website's private communications without changing TLS or upgrading a CDN. InviCloak builds a lightweight but secure and practical key distribution mechanism using the existing DNS infrastructure to distribute a new public key associated with a website's domain name. A web client and a website can use the new key pair to build an encryption channel inside TLS. InviCloak accommodates the current web ecosystem. A website can deploy InviCloak unilaterally without a client's involvement to prevent a passive attacker inside a CDN from eavesdropping on their communications. If a client also installs InviCloak's browser extension, the client and the website can achieve end-to-end confidential and untampered communications in the presence of an active attacker inside a CDN. Our evaluation shows that InviCloak increases the median page load times (PLTs) of realistic web pages from 2.0s to 2.1s, which is smaller than the median PLTs (2.8s) of a state-of-the-art TEE-based solution.


title: Recurrent Bilinear Optimization for Binary Neural Networks

abstract: Binary Neural Networks (BNNs) show great promise for real-world embedded devices. As one of the critical steps to achieve a powerful BNN, the scale factor calculation plays an essential role in reducing the performance gap to their real-valued counterparts. However, existing BNNs neglect the intrinsic bilinear relationship of real-valued weights and scale factors, resulting in a sub-optimal model caused by an insufficient training process. To address this issue, Recurrent Bilinear Optimization is proposed to improve the learning process of BNNs (RBONNs) by associating the intrinsic bilinear variables in the back propagation process. Our work is the first attempt to optimize BNNs from the bilinear perspective. Specifically, we employ a recurrent optimization and Density-ReLU to sequentially backtrack the sparse real-valued weight filters, which will be sufficiently trained and reach their performance limits based on a controllable learning process. We obtain robust RBONNs, which show impressive performance over state-of-the-art BNNs on various models and datasets. Particularly, on the task of object detection, RBONNs have great generalization performance. Our code is open-sourced on https://github.com/SteveTsui/RBONN .


title: Algorithm for Finding an Exact Maximum Distance in E2 with Oexp(N) Complexity: Analysis and Experimental Results

abstract: This paper describes a novel and fast, simple and robust algorithm with O(N) expected complexity which enables to decrease run time needed to find the maximum distance of two points in E2. It can be easily modified for the E3 case in general. The proposed algorithm has been evaluated experimentally on larger different datasets in order to verify it and prove expected properties of it. Experiments proved the advantages of the proposed algorithm over the standard algorithms based on the Brute force, convex hull or convex hull diameters approaches. The proposed algorithm gives a significant speed-up to applications, when medium and large data sets are processed. It is over 10 000 times faster than the standard Brute force algorithm for 10 mil. points randomly distributed points in E2 and over 4 times faster than convex hull diameter computation. The speed-up of the proposed algorithm grows with the number of points processed.


title: Graphon-valued processes with vertex-level fluctuations

abstract: We consider a class of graph-valued stochastic processes in which each vertex has a type that fluctuates randomly over time. Collectively, the paths of the vertex types up to a given time determine the probabilities that the edges are active or inactive at that time. Our focus is on the evolution of the associated empirical graphon in the limit as the number of vertices tends to infinity, in the setting where fluctuations in the graph-valued process are more likely to be caused by fluctuations in the vertex types than by fluctuations in the states of the edges given these types. We derive both sample-path large deviation principles and convergence of stochastic processes. We demonstrate the flexibility of our approach by treating a class of stochastic processes where the edge probabilities depend not only on the fluctuations in the vertex types but also on the state of the graph itself.


title: OneQ: A Compilation Framework for Photonic One-Way Quantum Computation

abstract: In this paper, we propose OneQ, the first optimizing compilation framework for one-way quantum computation towards realistic photonic quantum architectures. Unlike previous compilation efforts for solid-state qubit technologies, our innovative framework addresses a unique set of challenges in photonic quantum computing. Specifically, this includes the dynamic generation of qubits over time, the need to perform all computation through measurements instead of relying on 1-qubit and 2-qubit gates, and the fact that photons are instantaneously destroyed after measurements. As pioneers in this field, we demonstrate the vast optimization potential of photonic one-way quantum computing, showcasing the remarkable ability of OneQ to reduce computing resource requirements by orders of magnitude.


title: Scenario-Based Test Reduction and Prioritization for Multi-Module Autonomous Driving Systems

abstract: When developing autonomous driving systems (ADS), developers often need to replay previously collected driving recordings to check the correctness of newly introduced changes to the system. However, simply replaying the entire recording is not necessary given the high redundancy of driving scenes in a recording (e.g., keeping the same lane for 10 minutes on a highway). In this paper, we propose a novel test reduction and prioritization approach for multi-module ADS. First, our approach automatically encodes frames in a driving recording to feature vectors based on a driving scene schema. Then, the given recording is sliced into segments based on the similarity of consecutive vectors. Lengthy segments are truncated to reduce the length of a recording and redundant segments with the same vector are removed. The remaining segments are prioritized based on both the coverage and the rarity of driving scenes. We implemented this approach on an industry level, multi-module ADS called Apollo and evaluated it on three road maps in various regression settings. The results show that our approach significantly reduced the original recordings by over 34% while keeping comparable test effectiveness, identifying almost all injected faults. Furthermore, our test prioritization method achieves about 22% to 39% and 41% to 53% improvements over three baselines in terms of both the average percentage of faults detected (APFD) and TOP-K.


title: Conditional Independence Testing via Latent Representation Learning

abstract: Detecting conditional independencies plays a key role in several statistical and machine learning tasks, especially in causal discovery algorithms. In this study, we introduce LCIT (Latent representation based Conditional Independence Test)-a novel non-parametric method for conditional independence testing based on representation learning. Our main contribution involves proposing a generative framework in which to test for the independence between X and Y given Z, we first learn to infer the latent representations of target variables X and Y that contain no information about the conditioning variable Z. The latent variables are then investigated for any significant remaining dependencies, which can be performed using the conventional partial correlation test. The empirical evaluations show that LCIT outperforms several state-of-the-art baselines consistently under different evaluation metrics, and is able to adapt really well to both non-linear and high-dimensional settings on a diverse collection of synthetic and real data sets.


title: Autonomous Cross Domain Adaptation under Extreme Label Scarcity

abstract: A cross domain multistream classification is a challenging problem calling for fast domain adaptations to handle different but related streams in never-ending and rapidly changing environments. Notwithstanding that existing multistream classifiers assume no labelled samples in the target stream, they still incur expensive labelling cost since they require fully labelled samples of the source stream. This paper aims to attack the problem of extreme label shortage in the cross domain multistream classification problems where only very few labelled samples of the source stream are provided before process runs. Our solution, namely Learning Streaming Process from Partial Ground Truth (LEOPARD), is built upon a flexible deep clustering network where its hidden nodes, layers and clusters are added and removed dynamically in respect to varying data distributions. A deep clustering strategy is underpinned by a simultaneous feature learning and clustering technique leading to clustering-friendly latent spaces. A domain adaptation strategy relies on the adversarial domain adaptation technique where a feature extractor is trained to fool a domain classifier classifying source and target streams. Our numerical study demonstrates the efficacy of LEOPARD where it delivers improved performances compared to prominent algorithms in 15 of 24 cases. Source codes of LEOPARD are shared in \url{https://github.com/wengweng001/LEOPARD.git} to enable further study.


title: The Broken Windows Theory Applies to Technical Debt

abstract: Context: The term technical debt (TD) describes the aggregation of sub-optimal solutions that serve to impede the evolution and maintenance of a system. Some claim that the broken windows theory (BWT), a concept borrowed from criminology, also applies to software development projects. The theory states that the presence of indications of previous crime (such as a broken window) will increase the likelihood of further criminal activity; TD could be considered the broken windows of software systems. Objective: To empirically investigate the causal relationship between the TD density of a system and the propensity of developers to introduce new TD during the extension of that system. Method: The study used a mixed-methods research strategy consisting of a controlled experiment with an accompanying survey and follow-up interviews. The experiment had a total of 29 developers of varying experience levels completing system extension tasks in already existing systems with high or low TD density. Results: The analysis revealed significant effects of TD level on the subjects' tendency to re-implement (rather than reuse) functionality, choose non-descriptive variable names, and introduce other code smells identified by the software tool SonarQube, all with at least 95% credible intervals. Conclusions: Three separate significant results along with a validating qualitative result combine to form substantial evidence of the BWT's existence in software engineering contexts. This study finds that existing TD can have a major impact on developers propensity to introduce new TD of various types during development.


title: The size--mass and other structural parameter ($n, \mu_z, R_z$) relations for local bulges/spheroids from multicomponent decompositions

abstract: We analyse the bulge/spheroid size-(stellar mass), $R_{\rm e,Sph}-M_{\rm *,Sph}$, relation and spheroid structural parameters for 202 local (predominantly $\lesssim 110~\rm Mpc$) galaxies spanning $ M_*\sim 3\times10^{9}-10^{12}~\rm M_{\odot}$ and $ 0.1 \lesssim R_{\rm e, Sph}\lesssim32~\rm kpc$ from multicomponent decomposition. The correlations between the spheroid S\'ersic index ($n_{\rm Sph}$), central surface brightness ($\mu_{\rm 0, Sph}$), effective half-light radius ($R_{\rm e, Sph}$), absolute magnitude ($\mathfrak{M}_{\rm Sph}$) and stellar mass ($M_{\rm *,Sph}$) are explored. We also investigate the consequences of using different scale radii, $R_{z,\rm Sph}$, encapsulating a different fraction ($z$, from 0 to 1) of the total luminosity. The correlation strengths for projected mass densities, $\Sigma_z$ and $\langle \Sigma \rangle_z$, vary significantly with the choice of $z$. Spheroid size ($R_{\rm z, Sph}$) and mass ($M_{\rm *,Sph}$) are strongly correlated for all light fractions $z$. We find: $\log(R_{\rm e,Sph}/\rm kpc) = 0.88\log(M_{\rm *,Sph}/\rm M_{\odot})-9.15$ with a small scatter of $\Delta_{rms} = 0.24~\rm dex$. This result is discussed relative to the \textit{curved} size-mass relation for early-type galaxies due to their discs yielding larger galaxy radii at lower masses. Moreover, the slope of our spheroid size-mass relation is a factor of $\sim3$, steeper than reported bulge size-mass relations, and with bulge sizes at $M_{\rm *,sph}\sim 3\times10^9~M_\odot$ which are 2 to 3 times smaller. Finally, we show that the local spheroids align well with quiescent galaxies at $z\sim1.25$--$2.25$. In essence, local spheroids and high-$z$ quiescent galaxies appear structurally similar, likely dictated by the virial theorem.


title: Learning to Deceive in Multi-Agent Hidden Role Games

abstract: Deception is prevalent in human social settings. However, studies into the effect of deception on reinforcement learning algorithms have been limited to simplistic settings, restricting their applicability to complex real-world problems. This paper addresses this by introducing a new mixed competitive-cooperative multi-agent reinforcement learning (MARL) environment inspired by popular role-based deception games such as Werewolf, Avalon, and Among Us. The environment's unique challenge lies in the necessity to cooperate with other agents despite not knowing if they are friend or foe. Furthermore, we introduce a model of deception, which we call Bayesian belief manipulation (BBM) and demonstrate its effectiveness at deceiving other agents in this environment while also increasing the deceiving agent's performance.


title: 511 keV galactic line from first-order phase transitions and primordial black holes

abstract: Hawking evaporation of primordial black hole (PBH), with mass $3\times 10^{-17} \lesssim M_{\rm PBH}/M_\odot \lesssim 7\times 10^{-17}$ and fractional abundance $0.01 \lesssim f_{\rm PBH} \lesssim 0.5$, well reproduces 511 keV gamma-ray excess from galaxy center. In this work, we investigated the production mechanism of PBHs base on the first-order phase transition induced by quartic effective thermal potential of a scalar field in dark sector. We found the phase transition with vacuum energy, $\mathcal{O}(1)\lesssim B^{1/4}/{\rm MeV} \lesssim \mathcal{O}(100)$, produces the desired PBH mass and abundance fraction. Correlated signatures of gravitational wave and extragalactic gamma-ray from phase transition and black hole evaporation, respectively, are within $\mu$Ares and AMEGO/e-ASTROGAM projected sensitivities.


title: The effect of configurational complexity in heteropolymers on the coil-globule phase-transition

abstract: The coil-globule transition of hetero-polymer chains is studied here. By means of extensive Molecular Dynamics simulations, we show that the transition is directly linked to the complexity of the chain, which depends on the number of chemical species defined in the environment and the location of the binding sites along the polymer. In addition, when the number of species increases, we find that the distribution of binding sites plays an important role in triggering the transition, beyond the standard control parameters of the polymer model, i.e. binders concentration and binding affinity. Overall, our results show that by increasing the system complexity new organizational layers emerge, thus allowing a more structured control on the polymer thermodynamic state. This can be potentially applied to the study of chromatin architecture, as such polymer models have been broadly used to understand the molecular mechanisms of genome folding.


title: Single-pixel imaging of a translational object

abstract: Image-free tracking methods based on single-pixel detectors (SPDs) can track a moving object at a very high frame rate, but they rarely can achieve simultaneous imaging of such an object. In this study, we propose a method for simultaneously obtaining the relative displacements and images of a translational object. Four binary Fourier patterns and two differential Hadamard patterns are used to modulate one frame of the object and then modulated light signals are obtained by SPD. The relative displacements and image of the moving object can be gradually obtained along with the detection. The proposed method does not require any prior knowledge of the object and its motion. The method has been verified by simulations and experiments, achieving a frame rate of 3332 Hz to acquire relative displacements of a translational object at a spatial resolution of $128 \times 128$ pixels using a 20000-Hz digital micro-mirror device. This proposed method can broaden the application of image-free tracking methods and obtain spatial information about moving objects.


title: Latent Preserving Generative Adversarial Network for Imbalance classification

abstract: Many real-world classification problems have imbalanced frequency of class labels; a well-known issue known as the "class imbalance" problem. Classic classification algorithms tend to be biased towards the majority class, leaving the classifier vulnerable to misclassification of the minority class. While the literature is rich with methods to fix this problem, as the dimensionality of the problem increases, many of these methods do not scale-up and the cost of running them become prohibitive. In this paper, we present an end-to-end deep generative classifier. We propose a domain-constraint autoencoder to preserve the latent-space as prior for a generator, which is then used to play an adversarial game with two other deep networks, a discriminator and a classifier. Extensive experiments are carried out on three different multi-class imbalanced problems and a comparison with state-of-the-art methods. Experimental results confirmed the superiority of our method over popular algorithms in handling high-dimensional imbalanced classification problems. Our code is available on https://github.com/TanmDL/SLPPL-GAN.


title: Reinforced Continual Learning for Graphs

abstract: Graph Neural Networks (GNNs) have become the backbone for a myriad of tasks pertaining to graphs and similar topological data structures. While many works have been established in domains related to node and graph classification/regression tasks, they mostly deal with a single task. Continual learning on graphs is largely unexplored and existing graph continual learning approaches are limited to the task-incremental learning scenarios. This paper proposes a graph continual learning strategy that combines the architecture-based and memory-based approaches. The structural learning strategy is driven by reinforcement learning, where a controller network is trained in such a way to determine an optimal number of nodes to be added/pruned from the base network when new tasks are observed, thus assuring sufficient network capacities. The parameter learning strategy is underpinned by the concept of Dark Experience replay method to cope with the catastrophic forgetting problem. Our approach is numerically validated with several graph continual learning benchmark problems in both task-incremental learning and class-incremental learning settings. Compared to recently published works, our approach demonstrates improved performance in both the settings. The implementation code can be found at \url{https://github.com/codexhammer/gcl}.


title: SolTrack: a free, fast and accurate routine to compute the position of the Sun

abstract: We present a simple, free, fast and accurate C/C++ and Python routine called SolTrack, which can compute the position of the Sun at any instant and any location on Earth. The code allows tracking of the Sun using a low-specs embedded processor, such as a PLC or a microcontroller, and can be used for applications in the field of (highly) concentrated (photovoltaic) solar power ((H)CPV and CSP), such as tracking control and yield modelling. SolTrack is accurate, fast and open in its use, and compares favourably with similar algorithms that are currently available for solar tracking and modelling. SolTrack computes $1.5 \times 10^6$ positions per second on a single 2.67GHz CPU core. For the period between the years 2017 and 2116 the uncertainty in position is $0.0036 \pm 0.0042^\circ$, that in solar distance 0.0017 $\pm$ 0.0029%. In addition, SolTrack computes rise, transit and set times to an accuracy better than 1 second. The code is freely available online (http://soltrack.sf.net, https://pypi.org/project/soltrack/).


title: Scalable Adversarial Online Continual Learning

abstract: Adversarial continual learning is effective for continual learning problems because of the presence of feature alignment process generating task-invariant features having low susceptibility to the catastrophic forgetting problem. Nevertheless, the ACL method imposes considerable complexities because it relies on task-specific networks and discriminators. It also goes through an iterative training process which does not fit for online (one-epoch) continual learning problems. This paper proposes a scalable adversarial continual learning (SCALE) method putting forward a parameter generator transforming common features into task-specific features and a single discriminator in the adversarial game to induce common features. The training process is carried out in meta-learning fashions using a new combination of three loss functions. SCALE outperforms prominent baselines with noticeable margins in both accuracy and execution time.


title: Hierarchical Transformer with Spatio-Temporal Context Aggregation for Next Point-of-Interest Recommendation

abstract: Next point-of-interest (POI) recommendation is a critical task in location-based social networks, yet remains challenging due to a high degree of variation and personalization exhibited in user movements. In this work, we explore the latent hierarchical structure composed of multi-granularity short-term structural patterns in user check-in sequences. We propose a Spatio-Temporal context AggRegated Hierarchical Transformer (STAR-HiT) for next POI recommendation, which employs stacked hierarchical encoders to recursively encode the spatio-temporal context and explicitly locate subsequences of different granularities. More specifically, in each encoder, the global attention layer captures the spatio-temporal context of the sequence, while the local attention layer performed within each subsequence enhances subsequence modeling using the local context. The sequence partition layer infers positions and lengths of subsequences from the global context adaptively, such that semantics in subsequences can be well preserved. Finally, the subsequence aggregation layer fuses representations within each subsequence to form the corresponding subsequence representation, thereby generating a new sequence of higher-level granularity. The stacking of encoders captures the latent hierarchical structure of the check-in sequence, which is used to predict the next visiting POI. Extensive experiments on three public datasets demonstrate that the proposed model achieves superior performance whilst providing explanations for recommendations. Codes are available at https://github.com/JennyXieJiayi/STAR-HiT.


title: Selective Text Augmentation with Word Roles for Low-Resource Text Classification

abstract: Data augmentation techniques are widely used in text classification tasks to improve the performance of classifiers, especially in low-resource scenarios. Most previous methods conduct text augmentation without considering the different functionalities of the words in the text, which may generate unsatisfactory samples. Different words may play different roles in text classification, which inspires us to strategically select the proper roles for text augmentation. In this work, we first identify the relationships between the words in a text and the text category from the perspectives of statistical correlation and semantic similarity and then utilize them to divide the words into four roles -- Gold, Venture, Bonus, and Trivial words, which have different functionalities for text classification. Based on these word roles, we present a new augmentation technique called STA (Selective Text Augmentation) where different text-editing operations are selectively applied to words with specific roles. STA can generate diverse and relatively clean samples, while preserving the original core semantics, and is also quite simple to implement. Extensive experiments on 5 benchmark low-resource text classification datasets illustrate that augmented samples produced by STA successfully boost the performance of classification models which significantly outperforms previous non-selective methods, including two large language model-based techniques. Cross-dataset experiments further indicate that STA can help the classifiers generalize better to other datasets than previous methods.


title: Copula Entropy based Variable Selection for Survival Analysis

abstract: Variable selection is an important problem in statistics and machine learning. Copula Entropy (CE) is a mathematical concept for measuring statistical independence and has been applied to variable selection recently. In this paper we propose to apply the CE-based method for variable selection to survival analysis. The idea is to measure the correlation between variables and time-to-event with CE and then select variables according to their CE value. Experiments on simulated data and two real cancer data were conducted to compare the proposed method with two related methods: random survival forest and Lasso-Cox. Experimental results showed that the proposed method can select the 'right' variables out that are more interpretable and lead to better prediction performance.


title: An Iterative 5G Positioning and Synchronization Algorithm in NLOS Environments with Multi-Bounce Paths

abstract: 5G positioning is a very promising area that presents many opportunities and challenges. Many existing techniques rely on multiple anchor nodes and line-of-sight (LOS) paths, or single reference node and single-bounce non-LOS (NLOS) paths. However, in dense multipath environments, identifying the LOS or single-bounce assumptions is challenging. The multi-bounce paths will make the positioning accuracy deteriorate significantly. We propose a robust 5G positioning algorithm in NLOS multipath environments. The corresponding positioning problem is formulated as an iterative and weighted least squares problem, and different weights are utilized to mitigate the effects of multi-bounce paths. Numerical simulations are carried out to evaluate the performance of the proposed algorithm. Compared with the benchmark positioning algorithms only using the single-bounce paths, similar positioning accuracy is achieved for the proposed algorithm.


title: Point spread function reconstruction for SOUL+LUCI LBT data

abstract: This paper presents the status of an ongoing project aimed at developing a PSF reconstruction software for adaptive optics (AO) observations. In particular, we test for the first time the implementation of pyramid wave-front sensor data on our algorithms. As a first step in assessing its reliability, we applied the software to bright, on-axis, point-like sources using two independent sets of observations, acquired with the single-conjugated AO upgrade for the Large Binocular Telescope. Using only telemetry data, we reconstructed the PSF by carefully calibrating the instrument response. The accuracy of the results has been first evaluated using the classical metric: specifically, the reconstructed PSFs differ from the observed ones by less than 2% in Strehl ratio and 4.5% in full-width at half maximum. Moreover, the recovered encircled energy associated with the PSF core is accurate at 4% level in the worst case. The accuracy of the reconstructed PSFs has then been evaluated by considering an idealized scientific test-case consisting in the measurements of the morphological parameters of a compact galaxy. In the future, our project will include the analysis of anisoplanatism, low SNR regimes, and the application to multi-conjugated AO observations.


title: MOCCA-Survey Database: Extra Galactic Globular Clusters. III. The population of black holes in Milky Way and Andromeda-like galaxies

abstract: In this work, we investigate the black hole (BH) population of globular clusters (GCs) in Milky Way- (MW) and Andromeda- (M31) like galaxies. We combine the population synthesis code MASinGa and the MOCCA-Survey Database I to infer the properties of GCs harbouring a BH subsystem (BHS), an IMBH, or neither of those. We find that the typical number of GCs with a BHS, an IMBH, or none become comparable in the galactic outskirts, whilst the inner galactic regions are dominated by GCs without a significant dark component. Our models suggest that GCs harbouring a BHS are slightly heavier and with larger half-mass radii compared to the overall population. We retrieve the properties of binary BHs (BBHs) that have either merged in the last 3 Gyr or survived in their parent cluster until present-day. We find that around 80\% of the merging BBHs form due to dynamical interactions while the remaining originate from evolution of primordial binaries. We infer a merger rate for BBHs in the local Universe of $1.0-23\,\,\rm{yr^{-1}\,Gpc^{-3}}$, depending on the adopted assumptions. We find around 100-240 BBHs survive until present-day and are mostly concentrated in the inner few kpc of the galaxy. We estimate also the number of BHs transported into the galactic nucleus by infalling star clusters, finding around 1,000-3,000 BHs and 100-200 BBHs are transported over a time span of 12 Gyr. This enables us to constrains the total amount of BHs and BBHs binaries lurking in nuclear star cluster, i.e. $N_{BHs}=(1.4-2.2)\times10^4$ and $N_{BBHs}=700-1,100$.


title: Regularity of almost minimizers for the parabolic thin obstacle problem

abstract: In this paper, we study almost minimizers for the parabolic thin obstacle (or Signorini) problem with zero obstacle. We establish their $H^{\sigma,\sigma/2}$-regularity for every $0<\sigma<1$, as well as $H^{\beta,\beta/2}$-regularity of their spatial gradients on the either side of the thin space for some $0<\beta<1$. A similar result is also obtained for almost minimizers for the Signorini problem with variable H\"{o}lder coefficients.


title: Towards Top-Down Automated Development in Limited Scopes: A Neuro-Symbolic Framework from Expressibles to Executables

abstract: Deep code generation is a topic of deep learning for software engineering (DL4SE), which adopts neural models to generate code for the intended functions. Since end-to-end neural methods lack domain knowledge and software hierarchy awareness, they tend to perform poorly w.r.t project-level tasks. To systematically explore the potential improvements of code generation, we let it participate in the whole top-down development from \emph{expressibles} to \emph{executables}, which is possible in limited scopes. In the process, it benefits from massive samples, features, and knowledge. As the foundation, we suggest building a taxonomy on code data, namely code taxonomy, leveraging the categorization of code information. Moreover, we introduce a three-layer semantic pyramid (SP) to associate text data and code data. It identifies the information of different abstraction levels, and thus introduces the domain knowledge on development and reveals the hierarchy of software. Furthermore, we propose a semantic pyramid framework (SPF) as the approach, focusing on software of high modularity and low complexity. SPF divides the code generation process into stages and reserves spots for potential interactions. In addition, we conceived preliminary applications in software development to confirm the neuro-symbolic framework.


title: Pseudo-LiDAR for Visual Odometry

abstract: In the existing methods, LiDAR odometry shows superior performance, but visual odometry is still widely used for its price advantage. Conventionally, the task of visual odometry mainly rely on the input of continuous images. However, it is very complicated for the odometry network to learn the epipolar geometry information provided by the images. In this paper, the concept of pseudo-LiDAR is introduced into the odometry to solve this problem. The pseudo-LiDAR point cloud back-projects the depth map generated by the image into the 3D point cloud, which changes the way of image representation. Compared with the stereo images, the pseudo-LiDAR point cloud generated by the stereo matching network can get the explicit 3D coordinates. Since the 6 Degrees of Freedom (DoF) pose transformation occurs in 3D space, the 3D structure information provided by the pseudo-LiDAR point cloud is more direct than the image. Compared with sparse LiDAR, the pseudo-LiDAR has a denser point cloud. In order to make full use of the rich point cloud information provided by the pseudo-LiDAR, a projection-aware dense odometry pipeline is adopted. Most previous LiDAR-based algorithms sampled 8192 points from the point cloud as input to the odometry network. The projection-aware dense odometry pipeline takes all the pseudo-LiDAR point clouds generated from the images except for the error points as the input to the network. While making full use of the 3D geometric information in the images, the semantic information in the images is also used in the odometry task. The fusion of 2D-3D is achieved in an image-only based odometry. Experiments on the KITTI dataset prove the effectiveness of our method. To the best of our knowledge, this is the first visual odometry method using pseudo-LiDAR.


title: On the Usability (In)Security of In-App Browsing Interfaces in Mobile Apps

abstract: Due to the frequent encountering of web URLs in various application scenarios (e.g., chatting and email reading), many mobile apps build their in-app browsing interfaces (IABIs) to provide a seamless user experience. Although this achieves user-friendliness by avoiding the constant switching between the subject app and the system built-in browser apps, we find that IABIs, if not well designed or customized, could result in usability security risks. In this paper, we conduct the first empirical study on the usability (in)security of in-app browsing interfaces in both Android and iOS apps. Specifically, we collect a dataset of 25 high-profile mobile apps from five common application categories that contain IABIs, including Facebook and Gmail, and perform a systematic analysis (not end-user study though) that comprises eight carefully designed security tests and covers the entire course of opening, displaying, and navigating an in-app web page. During this process, we obtain three major security findings: (1) about 30% of the tested apps fail to provide enough URL information for users to make informed decisions on opening an URL; (2) nearly all custom IABIs have various problems in providing sufficient indicators to faithfully display an in-app page to users, whereas ten IABIs that are based on Chrome Custom Tabs and SFSafariViewController are generally secure; and (3) only a few IABIs give warnings to remind users of the risk of inputting passwords during navigating a (potentially phishing) login page. Most developers had acknowledged our findings but their willingness and readiness to fix usability issues are rather low compared to fixing technical vulnerabilities, which is a puzzle in usability security research. Nevertheless, to help mitigate risky IABIs and guide future designs, we propose a set of secure IABI design principles.


title: Structure and approximation properties of Laplacian-like matrices

abstract: Many of today's problems require techniques that involve the solution of arbitrarily large systems $A\mathbf{x}=\mathbf{b}$. A popular numerical approach is the so-called Greedy Rank-One Update Algorithm, based on a particular tensor decomposition. The numerical experiments support the fact that this algorithm converges especially fast when the matrix of the linear system is Laplacian-Like. These matrices that follow the tensor structure of the Laplacian operator are formed by sums of Kronecker product of matrices following a particular pattern. Moreover, this set of matrices is not only a linear subspace it is a a Lie sub-algebra of a matrix Lie Algebra. In this paper, we characterize and give the main properties of this particular class of matrices. Moreover, the above results allow us to propose an algorithm to explicitly compute the orthogonal projection onto this subspace of a given square matrix $A \in \mathbb{R}^{N\times N}.$


title: Fourier restriction estimates on quantum Euclidean spaces

abstract: In this paper, we initiate the study of the Fourier restriction phenomena on quantum Euclidean spaces, and establish the analogues of the Tomas-Stein restriction theorem and the two-dimensional full restriction theorem.


title: Nuclear masses and the equation of state of nuclear matter

abstract: The incompressible liquid-drop (ILD) model reproduces masses of stable nuclei rather well. Here we show how the ILD volume, surface, symmetry, and Coulomb energies are related to the equation of state of nuclear matter using the Oyamatsu-Iida (OI) macroscopic nuclear model, which has reasonable many-body energy and isoscalar inhomogeneity gradient energy. We use 304 update interactions, covering wide ranges of the incompressibility $K_0$ of symmetric matter and the density slope of symmetry energy $L$, which fit almost equally empirical mass and radius data of stable nuclei. Thus, the $K_0$ and $L$ dependences are nearly frozen in stable nuclei as in the ILD model, leading to clear correlations among interaction and saturation parameters. Furthermore, we assume that the surface energy of the OI model is twice as large as the gradient energy using the size equilibrium conditions of the ILD and OI models. Then, the four energies of the ILD and OI models agree well for stable nuclei with $A \gtrsim 40$. Meanwhile, the OI model with $L \lesssim 100$ MeV predicts the latest mass data better than those of stable nuclei, and we suggest $20 \lesssim L \lesssim 90$ MeV, although the lower boundary is not constrained well.


title: Non-Hermitian dynamics of a two-spin system with PT symmetry

abstract: A system of interacting spins that are under the influence of spin-polarized currents can be described using a complex functional, or a non-Hermitian (NH) Hamiltonian. We study the dynamics of two exchange-coupled spins on the Bloch sphere. In the case of currents leading to PT symmetry, an exceptional point that survives also in the nonlinear system is identified. The nonlinear system is bistable for small currents and it exhibits stable oscillating motion or it can relax to a fixed point. The oscillating motion of the two spins is akin to synchronized spin-torque oscillators. For the full nonlinear system, we derive two conserved quantities that furnish a geometric description of the spin trajectories in phase space and indicate stability of the oscillating motion. Our analytical results provide tools for the description of the dynamics of NH systems that are defined on the Bloch sphere.


title: Evolution of Local Structures in Alkali-Borate Glasses

abstract: We analyze the dependence of relative proportion of various characteristic clusters in binary alcali-borate glasses on modifier's concentration $x$. A pure $B_2O_3$ glass contains a huge amount of boroxol rings and some amount of boron atoms in between, linking the boroxol rings via oxygen bonds. The addition of the $Na_2O$ modifier creates four-coordinated borons, but the resulting network glass remains totally connected. We study local transformations that lead to creation of new configurations like tetraborates, pentaborates, diborates, etc., and set forth a non-linear differential system similar to the Lotka-Volterra model. The resulting density curves of various local confugurations as functions of $x$ are obtained. Then the average rigidity is evaluated, enabling us to compute the glass transition temperature $T_g(x)$ for a given value of $x$


title: Schwarzschild-type black holes in Starobinsky-Bel-Robinson gravity

abstract: We study physical properties of a Schwarzschild-type black hole in the framework of the recently proposed Starobinsky-Bel-Robinson (SBR) modified theory of gravity, working perturbatively in the new coupling constant. In particular, we compute the temperature, entropy, pressure and lifetime of a Schwarzschild-type black hole.


title: Breaking the rules at $z\simeq$0.45: the rebel case of RBS 1055

abstract: We report on a long (250 ks) NuSTAR observation of the bright quasar RBS 1055 performed in March 2021, and archival XMM-Newton pointings (185 ks) taken in July 2014. An optical spectrum of the source taken with the Double Spectrograph at the Palomar Observatory, quasi-simultaneous with the NuSTAR observations, is also analyzed. We find that the two-coronae model, in which a warm and hot corona coexist, well reproduces its broad band spectrum, with temperatures kT$_e=0.12^{+0.08}_{-0.03}$ keV, kT$_e=30^{+40}_{-10}$ keV and Thomson optical depths $\tau$=30$_{-10}^{+15}$ and $\tau$=3.0$_{-1.4}^{+1.0}$ for the former and the latter component, respectively. We confirm the presence of an intense Fe K$\alpha$ emission line (EW=55$\pm$6 eV) and, when a toroidal model is considered for reproducing the Compton reflection, a Compton-thin solution with N$_{\rm H}=(3.2^{+0.9}_{-0.8})\times10^{23}$ cm$^{-2}$ for the circumnuclear reflector is found. The analysis of the optical spectrum reveals a likely peculiar configuration of our line of sight with respect to the nucleus, and the presence of a broad [O III] component, tracing outflows in the NLR, with a velocity shift $v=$1500$\pm100$ km s$^{-1}$, leading to a mass outflow rate $\dot{M}_{\rm out}=25.4\pm1.5$ M$_{\odot}$ yr$^{-1}$ and outflow kinetic power $\dot{E}_{\rm kin}$/L$_{\rm Bol}$ $\sim$0.33%. We estimate the BH mass to be in the range 2.8$\times$10$^{8}$-1.2$\times$10$^{9}$ M$_{\odot}$, according to different BLR emission lines, with an average value of <$M\rm_{BH}$>=6.5$\times$10$^{8}$ M$_{\odot}$. With an Fe K$\alpha$ which is 3$\sigma$ above the value predicted from the EW-L$_{2-10\ \rm keV}$ relation and an extreme source brightness at 2 keV (a factor 10-15 higher than the one expected from the optical/UV), RBS 1055 confirms to be an outlier in the X-rays, compared to other objects in the same luminosity and redshift range.


title: On holomorphic mappings with compact type range

abstract: Using Mujica's linearization theorem, we extend to the holomorphic setting some classical characterizations of compact (weakly compact, Rosenthal, Asplund) linear operators between Banach spaces such as the Schauder, Gantmacher and Gantmacher-Nakamura theorems and the Davis-Figiel-Johnson-Pelczynski, Rosenthal and Asplund factorization theorems.


title: Theory of intermolecular exchange in coupled spin-1/2 nanographenes

abstract: Open-shell nanographenes can be covalently bonded and still preserve their local moments, forming interacting spins lattices. In the case of benzenoid nanographenes, the Ovchinnikov-Lieb rules anticipate the spin of the ground state of the superstructure, and thereby the sign of the intermolecular exchange. Here we address the underlying microscopic mechanisms for intermolecular exchange in this type of system. We find that, in general, three different mechanisms contribute. First, Hund's ferromagnetic exchange that promotes ferromagnetic interactions of electrons in overlapping orbitals. Second, superexchange driven by intermolecular hybridization, identical to Anderson kinetic exchange, which is a decreasing function of the Hubbard-$U$ energy scale, and is always antiferromagnetic. Third, a Coulomb-driven superexchange, that increases as a function of $U$, and involves virtual excitation of excited molecular orbitals that are extended over the entire structure. We find that Coulomb-driven superexchange can be either ferro or antiferromagnetic, accounting for Ovchinnikov-Lieb rules. We compute these exchange energies for the case of coupled $S=1/2$ phenalenyl triangulenes, using multi-configurational methods both with Hubbard and extended Hubbard models, thereby addressing the influence of long-range Coulomb interactions on the exchange interactions.


title: Spatial-Temporal Transformer for Video Snapshot Compressive Imaging

abstract: Video snapshot compressive imaging (SCI) captures multiple sequential video frames by a single measurement using the idea of computational imaging. The underlying principle is to modulate high-speed frames through different masks and these modulated frames are summed to a single measurement captured by a low-speed 2D sensor (dubbed optical encoder); following this, algorithms are employed to reconstruct the desired high-speed frames (dubbed software decoder) if needed. In this paper, we consider the reconstruction algorithm in video SCI, i.e., recovering a series of video frames from a compressed measurement. Specifically, we propose a Spatial-Temporal transFormer (STFormer) to exploit the correlation in both spatial and temporal domains. STFormer network is composed of a token generation block, a video reconstruction block, and these two blocks are connected by a series of STFormer blocks. Each STFormer block consists of a spatial self-attention branch, a temporal self-attention branch and the outputs of these two branches are integrated by a fusion network. Extensive results on both simulated and real data demonstrate the state-of-the-art performance of STFormer. The code and models are publicly available at https://github.com/ucaswangls/STFormer.git


title: Rice Leaf Disease Classification and Detection Using YOLOv5

abstract: A staple food in more than a hundred nations worldwide is rice (Oryza sativa). The cultivation of rice is vital to global economic growth. However, the main issue facing the agricultural industry is rice leaf disease. The quality and quantity of the crops have declined, and this is the main cause. As farmers in any country do not have much knowledge about rice leaf disease, they cannot diagnose rice leaf disease properly. That's why they cannot take proper care of rice leaves. As a result, the production is decreasing. From literature survey, it has seen that YOLOv5 exhibit the better result compare to others deep learning method. As a result of the continual advancement of object detection technology, YOLO family algorithms, which have extraordinarily high precision and better speed have been used in various scene recognition tasks to build rice leaf disease monitoring systems. We have annotate 1500 collected data sets and propose a rice leaf disease classification and detection method based on YOLOv5 deep learning. We then trained and evaluated the YOLOv5 model. The simulation outcomes show improved object detection result for the augmented YOLOv5 network proposed in this article. The required levels of recognition precision, recall, mAP value, and F1 score are 90\%, 67\%, 76\%, and 81\% respectively are considered as performance metrics.


title: Autonomous Delivery of Multiple Packages Using Single Drone in Urban Airspace

abstract: Current drone delivery solutions mainly focus on single package delivery using one drone. However, the recent developments in drone technology enable a drone to deliver multiple packages in a single trip. We use the nearest destination first strategy for the faster delivery of packages in a skyway network. This demonstration is a proof-of-concept prototype for the multi-package delivery in urban airspace following a skyway network. We deploy and test this multi-package drone delivery in an indoor testbed environment using a 3D model of Sydney CBD. Demo: https://youtu.be/YTwsIfUvWPc


title: Differential Galois groups, specializations and Matzat's conjecture

abstract: We study families of linear differential equations parametrized by an algebraic variety $\mathcal{X}$ and show that the set of all points $x\in \mathcal{X}$, such that the differential Galois group at the generic fibre specializes to the differential Galois group at the fibre over $x$, is Zariski dense in $\mathcal{X}$. As an application, we prove Matzat's conjecture in full generality: The absolute differential Galois group of a one-variable function field over an algebraically closed field of characteristic zero is a free proalgebraic group.


title: PhishClone: Measuring the Efficacy of Cloning Evasion Attacks

abstract: Web-based phishing accounts for over 90% of data breaches, and most web-browsers and security vendors rely on machine-learning (ML) models as mitigation. Despite this, links posted regularly on anti-phishing aggregators such as PhishTank and VirusTotal are shown to easily bypass existing detectors. Prior art suggests that automated website cloning, with light mutations, is gaining traction with attackers. This has limited exposure in current literature and leads to sub-optimal ML-based countermeasures. The work herein conducts the first empirical study that compiles and evaluates a variety of state-of-the-art cloning techniques in wide circulation. We collected 13,394 samples and found 8,566 confirmed phishing pages targeting 4 popular websites using 7 distinct cloning mechanisms. These samples were replicated with malicious code removed within a controlled platform fortified with precautions that prevent accidental access. We then reported our sites to VirusTotal and other platforms, with regular polling of results for 7 days, to ascertain the efficacy of each cloning technique. Results show that no security vendor detected our clones, proving the urgent need for more effective detectors. Finally, we posit 4 recommendations to aid web developers and ML-based defences to alleviate the risks of cloning attacks.


title: A giant umbrella-like stellar stream around the tidal ring galaxy NGC 922

abstract: Tidal ring galaxies are observed rarely in the local universe due to their intrinsically transient nature. The tidal ring structures are the result of strong interactions between gas-rich stellar disks and smaller galactic systems and do not last longer than ~500~Myr therefore, these are perfect scenarios where to find the debris of recently accreted dwarf galactic systems. We present new deep images of the NGC 922 tidal ring galaxy and its surroundings from the DESI Legacy survey data and from our observations with an amateur telescope. These observations are compared with results from high-resolution N-body simulations designed to reproduce an alternative formation scenario for this peculiar galaxy. Our new observations unveil that the low surface brightness stellar tidal structures around NGC 922 are much more complex than reported in previous works. In particular, the formerly detected tidal spike-like structure at the northeast of the central galaxy disk is not connected with the dwarf companion galaxy PGC3080368, which has been suggested as the intruder triggering the ring formation of NGC 922. The deep images reveal that this tidal structure is mainly composed by a fainter giant umbrella-like shape and thus it was formed from the tidal disruption of a different satellite. Using the broad-band g, r and z DESI LS images, we measured the photometric properties of this stellar stream, estimating a total absolute magnitude in r-band of Mr= -17.0 +/- 0.03 magn and a total stellar mass for the stream between 6.9-8.5X10^8 Mo. We perform a set of N-body simulations to reproduce the observed NGC 922-intruder interaction, suggesting a new scenario for the formation of its tidal ring from the in-fall of a gas rich satellite around 150 Myr ago.


title: The Approximate Degree of DNF and CNF Formulas

abstract: The approximate degree of a Boolean function $f\colon\{0,1\}^n\to\{0,1\}$ is the minimum degree of a real polynomial $p$ that approximates $f$ pointwise: $|f(x)-p(x)|\leq1/3$ for all $x\in\{0,1\}^n.$ For every $\delta>0,$ we construct CNF and DNF formulas of polynomial size with approximate degree $\Omega(n^{1-\delta}),$ essentially matching the trivial upper bound of $n.$ This improves polynomially on previous lower bounds and fully resolves the approximate degree of constant-depth circuits ($\text{AC}^0$), a question that has seen extensive research over the past 10 years. Previously, an $\Omega(n^{1-\delta})$ lower bound was known only for $\text{AC}^0$ circuits of depth that grows with $1/\delta$ (Bun and Thaler, FOCS 2017). Moreover, our CNF and DNF formulas are the simplest possible in that they have constant width. Our result holds even for one-sided approximation, and has the following further consequences. (i) We essentially settle the communication complexity of $\text{AC}^0$ circuits in the bounded-error quantum model, $k$-party number-on-the-forehead randomized model, and $k$-party number-on-the-forehead nondeterministic model: we prove that for every $\delta>0$, these models require $\Omega(n^{1-\delta})$, $\Omega(n/4^kk^2)^{1-\delta}$, and $\Omega(n/4^kk^2)^{1-\delta}$, respectively, bits of communication even for polynomial-size constant-width CNF formulas. (ii) In particular, we show that the multiparty communication class $\text{coNP}_k$ can be separated essentially optimally from $\text{NP}_k$ and $\text{BPP}_k$ by a particularly simple function, a polynomial-size constant-width CNF. (iii) We give an essentially tight separation, of $O(1)$ versus $\Omega(n^{1-\delta})$, for the one-sided versus two-sided approximate degree of a function; and $O(1)$ versus $\Omega(n^{1-\delta})$ for the one-sided approximate degree of a function $f$ versus its negation $\neg f$.


title: Migrating Thermal Tides in the Martian Atmosphere during Aphelion Season Observed by EMM/EMIRS

abstract: Temperature profiles retrieved using the first set of data of the Emirates Mars InfraRed Spectrometer (EMIRS) obtained during the science phase of the Emirates Mars Mission (EMM) are used for the analysis of migrating thermal tides in the Martian atmosphere. The selected data cover a solar longitude (LS) range of 60{\deg}-90{\deg} of Martian Year (MY) 36. The novel orbit design of the Hope Probe leads to a good geographic and local time coverage that significantly improves the analysis. Wave mode decomposition suggests dominant diurnal tide and important semi-diurnal tide with maximal amplitudes of 6K and 2K, respectively, as well as the existence of ~0.5K ter-diurnal tide. The results agree well with predictions by the Mars Planetary Climate Model (PCM), but the observed diurnal tide has an earlier phase (3h), and the semi-diurnal tide has an unexpectedly large wavelength (~200km).


title: Probing Phase Structure of Strongly Coupled Matter with Holographic Entanglement Measures

abstract: We study the holographic entanglement measures such as the holographic mutual information, HMI, and the holographic entanglement of purification, EoP, in a holographic QCD model at finite temperature and zero chemical potential. This model can realize various types of phase transitions including crossover, first order and second order phase transitions. We use the HMI and EoP to probe the phase structure of this model and we find that at the critical temperature they can characterize the phase structure of the model. Moreover we obtain the critical exponent using the HMI and EoP.


title: Tight Chernoff-Like Bounds Under Limited Independence

abstract: This paper develops sharp bounds on moments of sums of k-wise independent bounded random variables, under constrained average variance. The result closes the problem addressed in part in the previous works of Schmidt et al. and Bellare, Rompel. We The work also discuss discusses other applications of independent interests, such as asymptotically sharp bounds on binomial moments.


title: Smoothers Based on Nonoverlapping Domain Decomposition Methods for $H(\mathbf{curl})$ Problems: A Numerical Study

abstract: This paper presents a numerical study on multigrid algorithms of $V$-cycle type for problems posed in the Hilbert space $H(\mathbf{curl})$ in three dimensions. The multigrid methods are designed for discrete problems originated from the discretization using the hexahedral N\'{e}d\'{e}lec edge element of the lowest-order. Our suggested methods are associated with smoothers constructed by substructuring based on domain decomposition methods of nonoverlapping type. Numerical experiments to demonstrate the robustness and the effectiveness of the suggested algorithms are also provided.


title: Consistent-Teacher: Towards Reducing Inconsistent Pseudo-targets in Semi-supervised Object Detection

abstract: In this study, we dive deep into the inconsistency of pseudo targets in semi-supervised object detection (SSOD). Our core observation is that the oscillating pseudo-targets undermine the training of an accurate detector. It injects noise into the student's training, leading to severe overfitting problems. Therefore, we propose a systematic solution, termed ConsistentTeacher, to reduce the inconsistency. First, adaptive anchor assignment~(ASA) substitutes the static IoU-based strategy, which enables the student network to be resistant to noisy pseudo-bounding boxes. Then we calibrate the subtask predictions by designing a 3D feature alignment module~(FAM-3D). It allows each classification feature to adaptively query the optimal feature vector for the regression task at arbitrary scales and locations. Lastly, a Gaussian Mixture Model (GMM) dynamically revises the score threshold of pseudo-bboxes, which stabilizes the number of ground truths at an early stage and remedies the unreliable supervision signal during training. ConsistentTeacher provides strong results on a large range of SSOD evaluations. It achieves 40.0 mAP with ResNet-50 backbone given only 10% of annotated MS-COCO data, which surpasses previous baselines using pseudo labels by around 3 mAP. When trained on fully annotated MS-COCO with additional unlabeled data, the performance further increases to 47.7 mAP. Our code is available at \url{https://github.com/Adamdad/ConsistentTeacher}.


title: How swimming style affects schooling of two fish-like wavy hydrofoils

abstract: Fish swimming style and schooling behaviour are two important aspects of underwater locomotion. How swimming style affects fish schooling is investigated by a representative problem setup consisting of two tethered NACA0012 hydrofoils undulating in a free stream flow at various wavelengths $ \lambda^* = 0.8 - 8 $, front-back distance $ D = 0,\ 0.25,\ 0.5,\ 0.75 $, phase difference $ \phi/\pi = 0,\ 0.5,\ 1,\ 1.5 $, and lateral gap distance $ G = 0.25,\ 0.3,\ 0.35 $ with fixed Reynolds number $ Re = 5000 $, Strouhal number $ St = 0.4 $, and maximum amplitude $ A_{max} = 0.1 $. In total, 336 cases were simulated by open-source software IBAMR based on immersed boundary method. The increase in wavelength generally leads to higher thrust and lateral force, consistent with a previous study regarding a single swimmer. The highest Froude efficiency is obtained at intermediate wavelength $ \lambda^* = 2 $ for either individual or two foils as a group. At side-by-side arrangement $ D = 0 $, the thrust force upon the two foils can be equivalent, indicating a stable formation. At staggered arrangement, $ D > 0 $, the follower can take significant advantage of the leader in locomotion performance by tuning phase difference. The follower's benefit decreases with relative distance. Various combinations of wavelength and relative distance can lead to distinct flow structures, indicating a tunable stealth capacity of the schooling swimmers.


title: Some smooth circle and cyclic group actions on exotic spheres

abstract: Classical work of Lee, Schultz, and Stolz relates the smooth transformation groups of exotic spheres to the stable homotopy groups of spheres. In this note, we apply recent progress on the latter to produce smooth circle and cyclic group actions on certain exotic spheres.


title: Protection of all nondefective twofold degeneracies by anti-unitary symmetries in non-Hermitian systems

abstract: Non-Hermitian degeneracies are classified as defective and nondefective exceptional points~(EP). While in defective EPs, both eigenvalues and eigenenergies coalesce, nondefective EPs are characterized merely by the occurrence of degeneracies in their eigenvalues. It is also known that all degeneracies are either symmetry-protected or accidental. In this paper, I prove that anti-unitary symmetries protect all nondefective twofold EPs. By developing a 2D non-Hermitian tight-binding model, I have demonstrated that these symmetries are composite of various symmetry operations such as discrete or spatial point-group symmetries and Wick's rotation in the non-Hermitian parameter space. Introducing these composite symmetries, I present the protection of nondefective EPs in various parameter regimes of my model. This work paves the way to stabilizing nondefective EPs and offers a new perspective on understanding non-Hermitian band crossings.


title: Charge-carrier complexes in monolayer semiconductors

abstract: The photoluminescence (PL) spectra of monolayer (1L) semiconductors feature peaks ascribed to different charge-carrier complexes. We perform diffusion quantum Monte Carlo simulations of the binding energies of these complexes and examine their response to electric and magnetic fields. We focus on quintons (charged biexcitons), since they are the largest free charge-carrier complexes in transition-metal dichalcogenides (TMDs). We examine the accuracy of the Rytova-Keldysh interaction potential between charges by comparing the binding energies of charge-carrier complexes in 1L-TMDs with results obtained using $\textit{ab initio}$ interaction potentials. Magnetic fields$<8$T change the binding energies (BEs) by$\sim0.2$ meV,T$^{-1}$, in agreement with experiments, with the BE variations of different complexes being very similar. Our results will help identify charge complexes in the PL spectra of 1L-semiconductors


title: On convergence and optimality of maximum-likelihood APA

abstract: Affine projection algorithm (APA) is a well-known algorithm in adaptive filtering applications such as audio echo cancellation. APA relies on three parameters: $P$ (projection order), $\mu$ (step size) and $\delta$ (regularization parameter). It is known that running APA for a fixed set of parameters leads to a tradeoff between convergence speed and accuracy. Therefore, various methods for adaptively setting the parameters have been proposed in the literature. Inspired by maximum likelihood (ML) estimation, we derive a new ML-based approach for adaptively setting the parameters of APA, which we refer to as ML-APA. For memoryless Gaussian inputs, we fully characterize the expected misalignment error of ML-APA as a function of iteration number and show that it converges to zero as $O({1\over t})$. We further prove that the achieved error is asymptotically optimal. ML-APA updates its estimate once every $P$ samples. We also propose incremental ML-APA (IML-APA), which updates the coefficients at every time step and outperforms ML-APA in our simulations results. Our simulation results verify the analytical conclusions for memoryless inputs and show that the new algorithms also perform well for strongly correlated input signals.


title: Big Bang Nucleosynthesis constraints on $f(T,T_G)$ gravity

abstract: We confront $f(T,T_G)$ gravity, with Big Bang Nucleosynthesis (BBN) requirements. The former is obtained using both the torsion scalar, as well as the teleparallel equivalent of the Gauss-Bonnet term, in the Lagrangian, resulting to modified Friedmann equations in which the extra torsional terms constitute an effective dark energy sector. We calculate the deviations of the freeze-out temperature $T_f$, caused by the extra torsion terms in comparison to $\Lambda$CDM paradigm. Then we impose five specific $f(T,T_G)$ models and we extract the constraints on the model parameters in order for the ratio $|\Delta T_f/ T_f|$ to satisfy the observational BBN bound. As we find, in most of the models the involved parameters are bounded in a narrow window around their General Relativity values as expected, as in the power-law model where the exponent $n$ needs to be $n\lesssim 0.5$. Nevertheless the logarithmic model can easily satisfy the BBN constraints for large regions of the model parameters. This feature should be taken into account in future model building.


title: A Prufer-Sequence Based Representation of Large Graphs for Structural Encoding of Logic Networks

abstract: The pervasiveness of graphs in today's real life systems is quite evident, where the system either explicitly exists as graph or can be readily modelled as one. Such graphical structure is thus a store house rich information. This has various implication depending on whether we are interested in a node or the graph as a whole. In this paper, we are primarily concerned with the later, that is, the inference that the structure of the graph influences the property of the real life system it represents. A model of such structural influence would be useful in inferencing useful properties of complex and large systems, like VLSI circuits, through its structural property. However, before we can apply some machine learning (ML) based technique to model such relationship, an effective representation of the graph is imperative. In this paper, we propose a graph representation which is lossless, linear-sized in terms of number of vertices and gives a 1-D representation of the graph. Our representation is based on Prufer encoding for trees. Moreover, our method is based on a novel technique, called $\mathcal{GT}$-enhancement whereby we first transform the graph such that it can be represented by a singular tree. The encoding also provides scope to include additional graph property and improve the interpretability of the code.


title: Data-Assisted Vision-Based Hybrid Control for Robust Stabilization with Obstacle Avoidance via Learning of Perception Maps

abstract: We study the problem of target stabilization with robust obstacle avoidance in robots and vehicles that have access only to vision-based sensors for the purpose of realtime localization. This problem is particularly challenging due to the topological obstructions induced by the obstacle, which preclude the existence of smooth feedback controllers able to achieve simultaneous stabilization and robust obstacle avoidance. To overcome this issue, we develop a vision-based hybrid controller that switches between two different feedback laws depending on the current position of the vehicle using a hysteresis mechanism and a data-assisted supervisor. The main innovation of the paper is the incorporation of suitable perception maps into the hybrid controller. These maps can be learned from data obtained from cameras in the vehicles and trained via convolutional neural networks (CNN). Under suitable assumptions on this perception map, we establish theoretical guarantees for the trajectories of the vehicle in terms of convergence and obstacle avoidance. Moreover, the proposed vision-based hybrid controller is numerically tested under different scenarios, including noisy data, sensors with failures, and cameras with occlusions.


title: Rigged Hilbert Space Approach for Non-Hermite Systems with Positive Definite Metric

abstract: We investigate Dirac's bra-ket formalism based on a rigged Hilbert space for a non-Hermite quantum system with a positive-definite metric. First, the rigged Hilbert space, characterized by positive-definite metric, is established. With the aid of the nuclear spectral theorem for the obtained rigged Hilbert space, spectral expansions are shown for the bra-kets by the generalized eigenvectors of a quasi-Hermite operator. The spectral expansions are utilized to endow the complete bi-orthogonal system and the transformation theory between the Hermite and non-Hermite systems. As an example of application, we show a specific description of our rigged Hilbert space treatment for some parity-time symmetrical quantum systems.


title: DMiner: Dashboard Design Mining and Recommendation

abstract: Dashboards, which comprise multiple views on a single display, help analyze and communicate multiple perspectives of data simultaneously. However, creating effective and elegant dashboards is challenging since it requires careful and logical arrangement and coordination of multiple visualizations. To solve the problem, we propose a data-driven approach for mining design rules from dashboards and automating dashboard organization. Specifically, we focus on two prominent aspects of the organization: arrangement, which describes the position, size, and layout of each view in the display space; and coordination, which indicates the interaction between pairwise views. We build a new dataset containing 854 dashboards crawled online, and develop feature engineering methods for describing the single views and view-wise relationships in terms of data, encoding, layout, and interactions. Further, we identify design rules among those features and develop a recommender for dashboard design. We demonstrate the usefulness of DMiner through an expert study and a user study. The expert study shows that our extracted design rules are reasonable and conform to the design practice of experts. Moreover, a comparative user study shows that our recommender could help automate dashboard organization and reach human-level performance. In summary, our work offers a promising starting point for design mining visualizations to build recommenders.


title: Scattering for non-radial 3D NLS with combined nonlinearities

abstract: We show scattering below the ground state energy level for a class of nonlinear 3D Schr\"odinger equations (NLS) with mass-energy intracritical competing nonlinearities. Specifically, the NLS has a focusing leading order nonlinearity with a defocusing perturbation. Our strategy combines interaction Morawetz estimates and a new crucial bound for the Pohozaev functional of localized functions. Furthermore, we give the rate of blow-up for symmetric solutions.


title: Spatial correlations of dark energy from quantum fluctuations in inflation

abstract: This paper contains a detailed study of the properties of a simple model attempting to explain dark energy as originated from quantum fluctuations of a light spectator scalar field in inflation. In [1] we recently outlined how Starobinsky's stochastic formalism can be used to study the spatial correlations imprinted on dark energy by its quantum origin in this model and we studied their possible role in relieving the Hubble tension. Here we provide a more comprehensive derivation of the results in [1] and we refine some of our estimates, comparing to the approximate results obtained previously. Among the main results, we analyze the non-coincident correlators predicted by a full field theoretical treatment and their relation with those computed within the stochastic formalism. We find that in the region where stochastic theory predicts significant sub-Hubble correlators it is in disagreement with field theoretical predictions. However, agreement can be restored by introducing a reduced speed of sound for the scalar field. We also discuss an alternative approach to the problem of studying correlators within the stochastic formalism based directly on the evolution of probability distributions. We find that the two approaches give the same answer for 2-point functions of the field, but not for 4-point functions relevant to density correlators and we discuss the behaviour of the two methods with respect to Wick's theorem.


title: Constraining the Coronal Heights and Readjustment Velocities Based on the Detection of a Few Hundred Seconds Delays in the Z Source GX 17+2

abstract: Neutron star Z type sources provide a unique platform in order to understand the structure of accretion disk-corona geometry emitting close to the Eddington luminosity. Using RXTE and NuSTAR satellite data, we performed cross correlation function (CCF) studies in GX 17+2 in order to constrain the size of corona responsible for hard X-rays. From the RXTE data, we found that during horizontal and normal branches, the CCFs show anti-correlated hard (16 - 30 keV) and soft (2 - 5 keV) X-ray delays of the order of a few tens to hundred seconds with a mean correlation coefficient of 0.42$\pm$0.11. Few observations shows correlated lags and on one occasion coincident with radio emission. We also report an anti-correlated hard X-ray delay of 113$\pm$51 s using the NuSTAR data of GX 17+2. Based on RXTE data, it was found that soft and hard X-ray fluxes are varying indicating the changes in the disk-corona structure during delays. We bridle the size of corona using relativistic precession, transition layer and boundary layer models. Assuming the delays to be readjustment time scale of disk-corona structure, height of the corona was estimated to be $\sim$ 17--100 km. Assuming that inner region of the truncated disk is occupied by the corona, we constrain the coronal readjustment velocities (v$_{corona}$=$\beta$ v$_{disk}$, where v$_{disk}$ is the radial velocity component of the disk) of the order of $\beta$=0.06-0.12. This study indicates that the observed delays are primarily dependent on the varying coronal readjustment velocities.


title: Exterior powers of a parabolic Springer sheaf on a Lie algebra

abstract: We compute the exterior powers, with respect to the additive convolution on the general linear Lie algebra, of a parabolic Springer sheaf corresponding to a maximal parabolic subgroup of type (1, n -- 1). They turn out to be isomorphic to the semisimple perverse sheaves attached by the Springer correspondence to the exterior powers of the permutation representation of the symmetric group.


title: Representative Image Feature Extraction via Contrastive Learning Pretraining for Chest X-ray Report Generation

abstract: Medical report generation is a challenging task since it is time-consuming and requires expertise from experienced radiologists. The goal of medical report generation is to accurately capture and describe the image findings. Previous works pretrain their visual encoding neural networks with large datasets in different domains, which cannot learn general visual representation in the specific medical domain. In this work, we propose a medical report generation framework that uses a contrastive learning approach to pretrain the visual encoder and requires no additional meta information. In addition, we adopt lung segmentation as an augmentation method in the contrastive learning framework. This segmentation guides the network to focus on encoding the visual feature within the lung region. Experimental results show that the proposed framework improves the performance and the quality of the generated medical reports both quantitatively and qualitatively.


title: CloudVision: DNN-based Visual Localization of Autonomous Robots using Prebuilt LiDAR Point Cloud

abstract: In this study, we propose a novel visual localization approach to accurately estimate six degrees of freedom (6-DoF) poses of the robot within the 3D LiDAR map based on visual data from an RGB camera. The 3D map is obtained utilizing an advanced LiDAR-based simultaneous localization and mapping (SLAM) algorithm capable of collecting a precise sparse map. The features extracted from the camera images are compared with the points of the 3D map, and then the geometric optimization problem is being solved to achieve precise visual localization. Our approach allows employing a scout robot equipped with an expensive LiDAR only once - for mapping of the environment, and multiple operational robots with only RGB cameras onboard - for performing mission tasks, with the localization accuracy higher than common camera-based solutions. The proposed method was tested on the custom dataset collected in the Skolkovo Institute of Science and Technology (Skoltech). During the process of assessing the localization accuracy, we managed to achieve centimeter-level accuracy; the median translation error was as low as 1.3 cm. The precise positioning achieved with only cameras makes possible the usage of autonomous mobile robots to solve the most complex tasks that require high localization accuracy.


title: Has J-PARC E07 observed a $\Xi^-_{1s}$ nuclear state?

abstract: The Strangeness ${\cal S}=-2$ J-PARC E07 emulsion experiment published recently two new $\Xi^-$--$^{14}$N capture events, IRRAWADDY and IBUKI, identified by observing weak-decay sequences of pairs of single-$\Lambda$ hypernuclei and interpreted as $\Xi^{-}_{1s}$ and $\Xi^{-}_{1p}$ nuclear bound states, respectively, with binding energies $B_{\Xi^-}^{1s}$=6.27$\pm$0.27 MeV and $B_{\Xi^-}^{1p}$=1.27$\pm$0.21 MeV. $\Xi^-$ capture events in emulsion play a major role in determining the $\Xi$-nuclear and the $\Lambda\Lambda$ potential strengths. Here we question the assignment of a $\Xi^{-}_{1s}$ nuclear bound state to IRRAWADDY and offer an alternative assignment as a near-threshold $\Xi^0_{1p}$--$^{14}$C nuclear bound state, slightly admixed with a $\Xi^{-}_{1p}$--$^{14}$N nuclear bound state component corresponding to IBUKI. We also question using IBUKI's $B_{\Xi^-}^{1p}$ value as is to determine the $\Xi$-nuclear potential depth. Altogether, $\Xi^-$ capture events in $^{12}$C and $^{16}$O should prove less ambiguous than in $^{14}$N.


title: A Case Study on the Classification of Lost Circulation Events During Drilling using Machine Learning Techniques on an Imbalanced Large Dataset

abstract: This study presents machine learning models that forecast and categorize lost circulation severity preemptively using a large class imbalanced drilling dataset. We demonstrate reproducible core techniques involved in tackling a large drilling engineering challenge utilizing easily interpretable machine learning approaches. We utilized a 65,000+ records data with class imbalance problem from Azadegan oilfield formations in Iran. Eleven of the dataset's seventeen parameters are chosen to be used in the classification of five lost circulation events. To generate classification models, we used six basic machine learning algorithms and four ensemble learning methods. Linear Discriminant Analysis (LDA), Logistic Regression (LR), Support Vector Machines (SVM), Classification and Regression Trees (CART), k-Nearest Neighbors (KNN), and Gaussian Naive Bayes (GNB) are the six fundamental techniques. We also used bagging and boosting ensemble learning techniques in the investigation of solutions for improved predicting performance. The performance of these algorithms is measured using four metrics: accuracy, precision, recall, and F1-score. The F1-score weighted to represent the data imbalance is chosen as the preferred evaluation criterion. The CART model was found to be the best in class for identifying drilling fluid circulation loss events with an average weighted F1-score of 0.9904 and standard deviation of 0.0015. Upon application of ensemble learning techniques, a Random Forest ensemble of decision trees showed the best predictive performance. It identified and classified lost circulation events with a perfect weighted F1-score of 1.0. Using Permutation Feature Importance (PFI), the measured depth was found to be the most influential factor in accurately recognizing lost circulation events while drilling.