title: Transfer RL via the Undo Maps Formalism

abstract: Transferring knowledge across domains is one of the most fundamental problems in machine learning, but doing so effectively in the context of reinforcement learning remains largely an open problem. Current methods make strong assumptions on the specifics of the task, often lack principled objectives, and -- crucially -- modify individual policies, which might be sub-optimal when the domains differ due to a drift in the state space, i.e., it is intrinsic to the environment and therefore affects every agent interacting with it. To address these drawbacks, we propose TvD: transfer via distribution matching, a framework to transfer knowledge across interactive domains. We approach the problem from a data-centric perspective, characterizing the discrepancy in environments by means of (potentially complex) transformation between their state spaces, and thus posing the problem of transfer as learning to undo this transformation. To accomplish this, we introduce a novel optimization objective based on an optimal transport distance between two distributions over trajectories -- those generated by an already-learned policy in the source domain and a learnable pushforward policy in the target domain. We show this objective leads to a policy update scheme reminiscent of imitation learning, and derive an efficient algorithm to implement it. Our experiments in simple gridworlds show that this method yields successful transfer learning across a wide range of environment transformations.


title: Towards Better Document-level Relation Extraction via Iterative Inference

abstract: Document-level relation extraction (RE) aims to extract the relations between entities from the input document that usually containing many difficultly-predicted entity pairs whose relations can only be predicted through relational inference. Existing methods usually directly predict the relations of all entity pairs of input document in a one-pass manner, ignoring the fact that predictions of some entity pairs heavily depend on the predicted results of other pairs. To deal with this issue, in this paper, we propose a novel document-level RE model with iterative inference. Our model is mainly composed of two modules: 1) a base module expected to provide preliminary relation predictions on entity pairs; 2) an inference module introduced to refine these preliminary predictions by iteratively dealing with difficultly-predicted entity pairs depending on other pairs in an easy-to-hard manner. Unlike previous methods which only consider feature information of entity pairs, our inference module is equipped with two Extended Cross Attention units, allowing it to exploit both feature information and previous predictions of entity pairs during relational inference. Furthermore, we adopt a two-stage strategy to train our model. At the first stage, we only train our base module. During the second stage, we train the whole model, where contrastive learning is introduced to enhance the training of inference module. Experimental results on three commonly-used datasets show that our model consistently outperforms other competitive baselines.


title: Spin-state Directed Synthesis of >20 micrometers 2D Layered Transition Metal Hydroxides via Edge-on Condensation

abstract: Layered transition metal hydroxides (LTMHs) with transition metal centers sandwiched between layers of coordinating hydroxide anions have attracted considerable interest for their potential in developing clean energy sources and storage technologies. However, two dimensional (2D) LTMHs remain largely unstudied in terms of their physical properties and the applications in electronic devices. Here, directed by the relationship of the spin state of 3d transition metal (TM) ions such as Ni, Co, Cu, and the corresponding geometry of the crystal field, we discover that Ni2+ with perfect Oh symmetry is ideal for intraplanar growth, leading to the achievement of >20 {\mu}m {\alpha}-Ni(OH)2 2D crystals with high yield, which are the largest 2D domains reported so far. We also report the successful synthesis of 2D Co(OH)2 crystals (>40 {\mu}m) with less yield due to the slight geometry distortion resulted from uneven number of electrons. Moreover, the detailed structural characterization of synthesized {\alpha}-Ni(OH)2 are performed; the optical band gap energy is extrapolated as 2.54 eV from optical absorption measurements and is measured as 2.50 eV from reflected electrons energy loss spectroscopy (REELS), suggesting the potential as insulating 2D dielectric material for electronic devices. Furthermore, key parameters of the hydrothermal reaction including soaking temperature, starting pH and cooling rate, are systematically tuned to understand their effects on morphological and crystallographic perspectives, allowing the establishment of a 2D growth mechanism. This work demonstrates a scalable pathway to synthesize large 2D LTMHs from simple methods, paving the way for the study of fundamental physical properties and device applications of 2D LTMHs.


title: A graph discretized approximation of semigroups for diffusion with drift and killing on a complete Riemannian manifold

abstract: In the present paper, we prove that the $C_{0}$-semigroup generated by a Schr\"odinger operator with drift on a complete Riemannian manifold is approximated by the discrete semigroups associated with a family of discrete time random walks with killing in a flow on a sequence of proximity graphs, which are constructed by partitions of the manifold. Furthermore, when the manifold is compact, we also obtain a quantitative error estimate of the convergence. Finally, we give examples of the partition of the manifold and the drift term on two typical manifolds: Euclidean spaces and model manifolds.


title: Comparison Between Mean-Variance and Monotone Mean-Variance Preferences Under Jump Diffusion and Stochastic Factor Model

abstract: This paper compares the optimal investment problems based on monotone mean-variance (MMV) and mean-variance (MV) preferences in the L\'{e}vy market with an untradable stochastic factor. It is an open question proposed by Trybu{\l}a and Zawisza. Using the dynamic programming and Lagrange multiplier methods, we get the HJBI and HJB equations corresponding to the two investment problems. The equations are transformed into a new-type parabolic equation, from which the optimal strategies under both preferences are derived. We prove that the two optimal strategies and value functions coincide if and only if an important market assumption holds. When the assumption violates, MMV investors act differently from MV investors. Thus, we conclude that the difference between continuous-time MMV and MV portfolio selections is due to the discontinuity of the market. In addition, we derive the efficient frontier and analyze the economic impact of the jump diffusion risky asset. We also provide empirical evidences to demonstrate the validity of the assumption in real financial market.


title: Full Temperature-Dependent Potential and Anharmonicity in Metallic Hydrogen: Colossal NQE and the Consequences

abstract: The temperature-dependent effective potential (TDEP) method for anharmonic phonon dispersion is generalized to the full potential case by combining with path integral formalism. This extension naturally resolves the intrinsic difficulty in the original TDEP at low temperature. The new method is applied to solid metallic hydrogen at high pressure. A colossal nuclear quantum effect (NQE) and subsequent anharmonicity are discovered, which not only leads to unexpectedly large drift of protons, but also slows down the convergence rate substantially when computing the phonon dispersions. By employing direct ab initio path integral molecular dynamics simulations as the benchmark, a possible breakdown of phonon picture in metallic hydrogen due to colossal NQE is indicated, implying novel lattice dynamical phenomena might exist. Inspired by this observation, a general theoretical formalism for quantum lattice dynamics beyond phonon is sketched, with the main features being discussed.


title: SGCE-Font: Skeleton Guided Channel Expansion for Chinese Font Generation

abstract: The automatic generation of Chinese fonts is an important problem involved in many applications. The predominated methods for the Chinese font generation are based on the deep generative models, especially the generative adversarial networks (GANs). However, existing GAN-based methods (say, CycleGAN) for the Chinese font generation usually suffer from the mode collapse issue, mainly due to the lack of effective guidance information. This paper proposes a novel information guidance module called the skeleton guided channel expansion (SGCE) module for the Chinese font generation through integrating the skeleton information into the generator with the channel expansion way, motivated by the observation that the skeleton embodies both local and global structure information of Chinese characters. We conduct extensive experiments to show the effectiveness of the proposed module. Numerical results show that the mode collapse issue suffered by the known CycleGAN can be effectively alleviated by equipping with the proposed SGCE module, and the CycleGAN equipped with SGCE outperforms the state-of-the-art models in terms of four important evaluation metrics and visualization quality. Besides CycleGAN, we also show that the suggested SGCE module can be adapted to other models for Chinese font generation as a plug-and-play module to further improve their performance.


title: Enumeration of Moire Patterns of a Hexagonal Twisted Bilayer and Intercalated Transition Metals in Twisted h-BN

abstract: A real-space method using generating integers is used to classify the possible moire patterns for two equal hexagonal lattices. The result is that the rotations that take (n,m) to (m,n) with n,m relatively prime form the fundamental moire transformations, and the number of lattice coincidence areas within each supercell is given by (n-m)^2. The scheme may be extended to cases where the lattice constants differ. Additionally, we consider a system with a transition metal between the layers of a twisted bilayer of h-BN. We find that the lowest energy configurations for such an arrangement are those at aligned and anti-aligned sites of the moire pattern, depending on the transition metal, and the low-symmetry sites possess high magnetization.


title: PCRED: Zero-shot Relation Triplet Extraction with Potential Candidate Relation Selection and Entity Boundary Detection

abstract: Zero-shot relation triplet extraction (ZeroRTE) aims to extract relation triplets from unstructured texts under the zero-shot setting, where the relation sets at the training and testing stages are disjoint. Previous state-of-the-art method handles this challenging task by leveraging pretrained language models to generate data as additional training samples, which increases the training cost and severely constrains the model performance. To address the above issues, we propose a novel method named PCRED for ZeroRTE with Potential Candidate Relation Selection and Entity Boundary Detection. The remarkable characteristic of PCRED is that it does not rely on additional data and still achieves promising performance. The model adopts a relation-first paradigm, recognizing unseen relations through candidate relation selection. With this approach, the semantics of relations are naturally infused in the context. Entities are extracted based on the context and the semantics of relations subsequently. We evaluate our model on two ZeroRTE datasets. The experiment results show that our method consistently outperforms previous works. Our code will be available at https://anonymous.4open.science/r/PCRED.


title: DynaVIG: Monocular Vision/INS/GNSS Integrated Navigation and Object Tracking for AGV in Dynamic Scenes

abstract: Visual-Inertial Odometry (VIO) usually suffers from drifting over long-time runs, the accuracy is easily affected by dynamic objects. We propose DynaVIG, a navigation and object tracking system based on the integration of Monocular Vision, Inertial Navigation System (INS), and Global Navigation Satellite System (GNSS). Our system aims to provide an accurate global estimation of the navigation states and object poses for the automated ground vehicle (AGV) in dynamic scenes. Due to the scale ambiguity of the object, a prior height model is proposed to initialize the object pose, and the scale is continuously estimated with the aid of GNSS and INS. To precisely track the object with complex moving, we establish an accurate dynamics model according to its motion state. Then the multi-sensor observations are optimized in a unified framework. Experiments on the KITTI dataset demonstrate that the multisensor fusion can effectively improve the accuracy of navigation and object tracking, compared to state-of-the-art methods. In addition, the proposed system achieves good estimation of the objects that change speed or direction.


title: Do the CO$_2$ absorption by plants and emission by growing media obey Fick's law?

abstract: A simple homemade greenhouse was constructed as a part of the high school project during the learning-from-home period. The greenhouse was used to show CO$_2$ absorption by Sansevieria trifasciata during the night, obeying Fick's law, while the CO$_2$ emission by the medium used to grow the plant does not. Although other plants can be used for this purpose, the use of Sansevieria is interesting and offers certain advantages because it absorbs CO$_2$ during the night. The project could also provide a simple tool for high school students to investigate the absorption and emission of CO$_2$ from home or in laboratory. Extension of this project to investigate the effect of plant respiration on the environmental parameters, such as decreasing temperature and increasing humidity, is also possible.


title: Machine Learning Algorithms for Predicting in-Hospital Mortality in Patients with ST-Segment Elevation Myocardial Infar

abstract: Acute myocardial infarction (AMI) is one of the most severe manifestation of coronary artery disease. ST-segment elevation myocardial infarction (STEMI) is the most serious type of AMI. We proposed to develop a machine learning algorithm based on the home page of electronic medical record (HPEMR) for predicting in-hospital mortality of patients with STEMI in the early stage. Methods: This observational study applied clinical information collected between 2013 and 2017 from 7 tertiary hospitals in Shenzhen, China. The patients' STEMI data were used to train 4 different machine learning algorithms to predict in-hospital mortality among the patients with STEMI, including Logistic Regression, Support Vector Machine, Gradient Boosting Decision Tree, and Artificial Neuron network. Results: A total of 5865 patients with STEMI were enrolled in our study. The model was developed by considering 3 types of variables, which included demographic data, diagnosis and comorbidities, and hospitalization information basing on HPEMR. The association of selected features using univariant logistic regression was reported. Specially, for the comorbidities, atrial fibrillation (OR: 11.0; 95% CI: 5.64 - 20.2), acute renal failure (OR: 9.75; 95% CI: 3.81 - 25.0), type 2 diabetic nephropathy (OR: 5.45; 95% CI: 1.57 - 19.0), acute heart failure (OR: 6.05; 95% CI: 1.99 - 14.9), and cardiac function grade IV (OR: 28.6; 95% CI: 20.6 - 39.6) were found to be associated with a high odds of death. Within the test dataset, our model showed a good discrimination ability as measured by area under the receiver operating characteristic curve (AUC; 0.879) (95% CI: 0.825 - 0.933).


title: End-to-End Learning for VCSEL-based Optical Interconnects: State-of-the-Art, Challenges, and Opportunities

abstract: Optical interconnects (OIs) based on vertical-cavity surface-emitting lasers (VCSELs) are the main workhorse within data centers, supercomputers, and even vehicles, providing low-cost, high-rate connectivity. VCSELs must operate under extremely harsh and time-varying conditions, thus requiring adaptive and flexible designs of the communication chain. Such designs can be built based on mathematical models (model-based design) or learned from data (machine learning (ML) based design). Various ML techniques have recently come to the forefront, replacing individual components in the transmitters and receivers with deep neural networks. Beyond such component-wise learning, end-to-end (E2E) autoencoder approaches can reach the ultimate performance through co-optimizing entire parameterized transmitters and receivers. This tutorial paper aims to provide an overview of ML for VCSEL-based OIs, with a focus on E2E approaches, dealing specifically with the unique challenges facing VCSELs, such as the wide temperature variations and complex models.


title: The gerrymander sequence, or A348456

abstract: Recently Kauers, Koutschan and Spahn announced a significant increase in the length of the so-called {\em gerrymander sequence}, given as A348456 in the OEIS, extending the sequence from 3 terms to 7 terms. We give a further extension to 11 terms, but more significantly prove that the coefficients grow as $\lambda^{4L^2},$ where $\lambda \approx 1.7445498, $ and is equal to the corresponding quantity for self-avoiding walks crossing a square (WCAS), or self-avoiding polygons crossing a square (PCAS). These are, respectively, OEIS sequences A007764 and A333323. Thus we have established a close connection between these previously separate problems. We have also related the sub-dominant behaviour to that of WCAS and PCAS, allowing us to conjecture that the coefficients of the gerrymander sequence A348456 grow as $\lambda^{4L^2+dL+e} \cdot L^g,$ where $d=-8.08708 \pm 0.0002,$ $e \approx 7.69$ and $g = 0.75 \pm 0.01,$ with $g$ almost certainly $3/4$ exactly. We also have generated 26 terms in the related gerrymander polynomial (defined below), and have been able to predict the asymptotic behaviour with a satisfying degree of precision. Indeed, it behaves exactly as $L$ times the corresponding coefficient of the generalised gerrymander sequence. The improved algorithm we give for counting these sequences is a variation of that which we recently developed for extending a number of sequences for SAWs and SAPs crossing a domain of the square or hexagonal lattices. It makes use of a minimal perfect hash function and in-place memory updating of the arrays for the counts of the number of paths.

categories: math.CO cond-mat.stat-mech math-ph math.MP


title: Residual Entropy of a Two-dimensional Ising Model with Crossing and Four-spin Interactions

abstract: We study the residual entropy of a two-dimensional Ising model with crossing and four-spin interactions, both for the case that in zero magnetic field and that in an imaginary magnetic field i({\pi}/2)kT. The spin configurations of this Ising model can be mapped into the hydrogen configurations of square ice with the defined standard direction of the hydrogen bonds. Making use of the equivalence of this Ising system with the exactly solved eight-vertex model and taking the low temperature limit, we obtain the residual entropy. Two soluble cases in zero field and one soluble case in imaginary field are examined. In the case that the free-fermion condition holds in zero field, we find the ground states in low temperature limit include the configurations disobeying the ice rules. In another case in zero field that the four-spin interactions are -{\infty}, and the case in imaginary field that the four-spin interactions are 0, the residual entropy exactly agrees with the result of square ice determined by Lieb in 1967. In the solutions of the latter two cases, we have shown alternative approaches to the residual entropy problem of square ice.


title: The log-Minkowski inequality of curvature entropy for non-symmetric convex bodies

abstract: In an earlier paper \cite{mazeng} the authors introduced the notion of curvature entropy, and proved the plane log-Minkowski inequality of curvature entropy under the symmetry assumption. In this paper we demonstrate the plane log-Minkowski inequality of curvature entropy for general convex bodies. The equivalence of the uniqueness of cone-volume measure, the log-Minkowski inequality of volume, and the log-Minkowski inequality of curvature entropy for general convex bodies in $\mathbb R^{2}$ are shown.


title: FastHuman: Reconstructing High-Quality Clothed Human in Minutes

abstract: We propose an approach for optimizing high-quality clothed human body shapes in minutes, using multi-view posed images. While traditional neural rendering methods struggle to disentangle geometry and appearance using only rendering loss, and are computationally intensive, our method uses a mesh-based patch warping technique to ensure multi-view photometric consistency, and sphere harmonics (SH) illumination to refine geometric details efficiently. We employ oriented point clouds' shape representation and SH shading, which significantly reduces optimization and rendering times compared to implicit methods. Our approach has demonstrated promising results on both synthetic and real-world datasets, making it an effective solution for rapidly generating high-quality human body shapes. Project page \href{https://l1346792580123.github.io/nccsfs/}{https://l1346792580123.github.io/nccsfs/}


title: Matching relative Rota-Baxter algebras, matching dendriform algebras and their cohomologies

abstract: The notion of matching Rota-Baxter algebras was recently introduced by Gao, Guo and Zhang [{\em J. Algebra} 552 (2020) 134-170] motivated by the study of algebraic renormalization of regularity structures. The concept of matching Rota-Baxter algebras generalizes multiple integral operators with kernels. The same authors also introduced matching dendriform algebras as the underlying structure of matching Rota-Baxter algebras. In this paper, we introduce matching relative Rota-Baxter algebras that are also related to matching dendriform algebras. We define a matching associative Yang-Baxter equation whose solutions give rise to matching relative Rota-Baxter algebras. Next, we introduce the cohomology of a matching relative Rota-Baxter algebra as a byproduct of the classical Hochschild cohomology and a new cohomology induced by the matching operators. As an application, we show that our cohomology governs the formal deformation theory of the matching relative Rota-Baxter algebra. Finally, using multiplicative nonsymmetric operads, we define the cohomology of a matching dendriform algebra and show that there is a morphism from the cohomology of a matching relative Rota-Baxter algebra to the cohomology of the induced matching dendriform algebra. We end this paper by considering homotopy matching dendriform algebras.


title: Receptive Field Refinement for Convolutional Neural Networks Reliably Improves Predictive Performance

abstract: Minimal changes to neural architectures (e.g. changing a single hyperparameter in a key layer), can lead to significant gains in predictive performance in Convolutional Neural Networks (CNNs). In this work, we present a new approach to receptive field analysis that can yield these types of theoretical and empirical performance gains across twenty well-known CNN architectures examined in our experiments. By further developing and formalizing the analysis of receptive field expansion in convolutional neural networks, we can predict unproductive layers in an automated manner before ever training a model. This allows us to optimize the parameter-efficiency of a given architecture at low cost. Our method is computationally simple and can be done in an automated manner or even manually with minimal effort for most common architectures. We demonstrate the effectiveness of this approach by increasing parameter efficiency across past and current top-performing CNN-architectures. Specifically, our approach is able to improve ImageNet1K performance across a wide range of well-known, state-of-the-art (SOTA) model classes, including: VGG Nets, MobileNetV1, MobileNetV3, NASNet A (mobile), MnasNet, EfficientNet, and ConvNeXt - leading to a new SOTA result for each model class.


title: Recurrent narrow quasi-periodic fast-propagating wave trains excited by the intermittent energy release in the accompanying solar flare

abstract: About the driven mechanisms of the quasi-periodic fast-propagating (QFP) wave trains, there exist two dominant competing physical explanations: associated with the flaring energy release or attributed to the waveguide dispersion. Employing Solar Dynamics Observatory (SDO) Atmospheric Imaging Assembly (AIA) 171 A images, we investigated a series of QFP wave trains composed of multiple wavefronts propagating along a loop system during the accompanying flare on 2011 November 11. The wave trains showed a high correlation in start time with the energy release of the accompanying flare. Measurements show that the wave trains phase speed is almost consistent with its group speed with a value of about 1000 km s-1, indicating that the wave trains should not be dispersed waves. The period of the wave trains was the same as that of the oscillatory signal in X ray emissions released by the flare. Thus we propose that the QFP wave trains were most likely triggered by the flare rather than by dispersion. We investigated the seismological application with the QFP waves and then obtained that the magnetic field strength of the waveguide was about 10 Gauss. Meanwhile, we also estimated that the energy flux of the wave trains was about 1.2X105 erg cm-2 s-1.


title: Mitigating Relational Bias on Knowledge Graphs

abstract: Knowledge graph data are prevalent in real-world applications, and knowledge graph neural networks (KGNNs) are essential techniques for knowledge graph representation learning. Although KGNN effectively models the structural information from knowledge graphs, these frameworks amplify the underlying data bias that leads to discrimination towards certain groups or individuals in resulting applications. Additionally, as existing debiasing approaches mainly focus on the entity-wise bias, eliminating the multi-hop relational bias that pervasively exists in knowledge graphs remains an open question. However, it is very challenging to eliminate relational bias due to the sparsity of the paths that generate the bias and the non-linear proximity structure of knowledge graphs. To tackle the challenges, we propose Fair-KGNN, a KGNN framework that simultaneously alleviates multi-hop bias and preserves the proximity information of entity-to-relation in knowledge graphs. The proposed framework is generalizable to mitigate the relational bias for all types of KGNN. We develop two instances of Fair-KGNN incorporating with two state-of-the-art KGNN models, RGCN and CompGCN, to mitigate gender-occupation and nationality-salary bias. The experiments carried out on three benchmark knowledge graph datasets demonstrate that the Fair-KGNN can effectively mitigate unfair situations during representation learning while preserving the predictive performance of KGNN models.


title: Resampling community detection to maximize propagation in complex network

abstract: Identifying important nodes in complex networks is essential in theoretical and applied fields. A small number of such nodes have deterministic power to decide information spreading, so it is of importance to find a set of nodes that maximize the propagation in networks. Based on baseline ranking methods, various improved methods were proposed, but there does not exist one enhanced method that covers all the base methods. In this paper, we propose a penalized method called RCD-Map, which is short for resampling community detection to maximize propagation, on five baseline ranking methods(Degree centrality, Closeness centrality, Betweennees centrality, K-shell and PageRank) with nodes' local community information. We perturbed the original graph by resampling to decrease the biases and randomness brought by community detection methods-both overlapping and non-overlapping methods. To assess the performance of our identifying method, SIR(susceptible-infected-recovered) model is applied to simulate the information propagation process. The result shows that methods with penalties perform better with a vaster propagation range in general.


title: Human-machine Interactive Tissue Prototype Learning for Label-efficient Histopathology Image Segmentation

abstract: Recently, deep neural networks have greatly advanced histopathology image segmentation but usually require abundant annotated data. However, due to the gigapixel scale of whole slide images and pathologists' heavy daily workload, obtaining pixel-level labels for supervised learning in clinical practice is often infeasible. Alternatively, weakly-supervised segmentation methods have been explored with less laborious image-level labels, but their performance is unsatisfactory due to the lack of dense supervision. Inspired by the recent success of self-supervised learning methods, we present a label-efficient tissue prototype dictionary building pipeline and propose to use the obtained prototypes to guide histopathology image segmentation. Particularly, taking advantage of self-supervised contrastive learning, an encoder is trained to project the unlabeled histopathology image patches into a discriminative embedding space where these patches are clustered to identify the tissue prototypes by efficient pathologists' visual examination. Then, the encoder is used to map the images into the embedding space and generate pixel-level pseudo tissue masks by querying the tissue prototype dictionary. Finally, the pseudo masks are used to train a segmentation network with dense supervision for better performance. Experiments on two public datasets demonstrate that our human-machine interactive tissue prototype learning method can achieve comparable segmentation performance as the fully-supervised baselines with less annotation burden and outperform other weakly-supervised methods. Codes will be available upon publication.


title: Enhancing Constraint Programming via Supervised Learning for Job Shop Scheduling

abstract: Constraint programming (CP) is a powerful technique for solving constraint satisfaction and optimization problems. In CP solvers, the variable ordering strategy used to select which variable to explore first in the solving process has a significant impact on solver effectiveness. To address this issue, we propose a novel variable ordering strategy based on supervised learning, which we evaluate in the context of job shop scheduling problems. Our learning-based methods predict the optimal solution of a problem instance and use the predicted solution to order variables for CP solvers. \added[]{Unlike traditional variable ordering methods, our methods can learn from the characteristics of each problem instance and customize the variable ordering strategy accordingly, leading to improved solver performance.} Our experiments demonstrate that training machine learning models is highly efficient and can achieve high accuracy. Furthermore, our learned variable ordering methods perform competitively when compared to four existing methods. Finally, we demonstrate that hybridising the machine learning-based variable ordering methods with traditional domain-based methods is beneficial.


title: Multi-fidelity Gaussian Process for Biomanufacturing Process Modeling with Small Data

abstract: In biomanufacturing, developing an accurate model to simulate the complex dynamics of bioprocesses is an important yet challenging task. This is partially due to the uncertainty associated with bioprocesses, high data acquisition cost, and lack of data availability to learn complex relations in bioprocesses. To deal with these challenges, we propose to use a statistical machine learning approach, multi-fidelity Gaussian process, for process modelling in biomanufacturing. Gaussian process regression is a well-established technique based on probability theory which can naturally consider uncertainty in a dataset via Gaussian noise, and multi-fidelity techniques can make use of multiple sources of information with different levels of fidelity, thus suitable for bioprocess modeling with small data. We apply the multi-fidelity Gaussian process to solve two significant problems in biomanufacturing, bioreactor scale-up and knowledge transfer across cell lines, and demonstrate its efficacy on real-world datasets.


title: Water and heat exchanges in mammalian lungs

abstract: A secondary function of the mammals' respiratory system is during inspiration to heat the air to body temperature and to saturate it with water before it reaches the alveoli. Relying on a mathematical model, we comprehensively analyze this function, considering all the terrestrial mammals (spanning six orders of magnitude of the body mass, $M$) and focusing on the sole contribution of the lungs to this air conditioning. The results highlight significant differences between the small and the large mammals, as well as between rest and effort, regarding the spatial distribution of heat and water exchanges in the lungs, and in terms of regime of mass transfer taking place in the lumen of the airways. Interestingly, the results show that the mammalian lungs appear to be designed just right to fully condition the air at maximal effort: all generations of the bronchial region of the lungs are mobilized for this purpose. For mammals with a mass above a certain threshold ($\simeq 5$ kg at rest and $\simeq 50$ g at maximal effort), it appears that the maximal value of this evaporation rate scales as $M^{-1/8}$ at rest and $M^{-1/16}$ at maximal effort and that around 40\% (at rest) or 50\% (at maximal effort) of the water/heat extracted from the lungs during inspiration is returned to the bronchial mucosa during expiration, independently of the mass, due to a subtle coupling between different phenomena. This last result implies that, above these thresholds, the amounts of water and heat extracted from the lungs by the ventilation scale with the mass such as the ventilation rate (i.e. as $M^{3/4}$ at rest and $M^{7/8}$ at maximal effort). Finally, it is worth mentioning that these amounts appear to remain limited, but not negligible when compared to relevant global quantities, even at maximal effort (4-6\%).


title: Variational Learning Algorithms For Channel Estimation in RIS-assisted mmWave Systems

abstract: We consider the problem of estimating the channel in reconfigurable intelligent surface (RIS) assisted millimeter wave (mmWave) systems. We propose two variational expectation maximization (VEM) based algorithms for channel estimation in RIS-aided wireless systems. The first algorithm is a structured mean field-based sparse Bayesian learning (SM-SBL) algorithm that exploits the doubly-structured sparsity and the individual sparsity of the elements of the channel. To exploit the sparsities, we propose a column-wise coupled Gaussian prior. We next design the factorized mean field-based algorithm based on the prior we propose. This algorithm called the factorized mean field SBL (FM-SBL) algorithm, addresses the time complexities of the SM-SBL algorithm without sacrificing channel estimation accuracy. We show using extensive numerical investigations that the i) proposed SM-SBL and FM-SBL algorithms outperform several existing algorithms and ii) FM-SBL has lower time complexity than the SM-SBL algorithm.


title: Identifying sinks and sources of human flows: A new approach to characterizing urban structures

abstract: Human flow data are rich behavioral data relevant to people's decision-making regarding where to live, work, go shopping, etc., and provide vital information for identifying city centers. However, it is not as easy to understand massive relational data, and datasets have often been reduced merely to the statistics of trip counts at destinations, discarding relational information from origin to destination. In this study, we propose an alternative center identification method based on human mobility data. This method extracts the scalar potential field of human trips based on combinatorial Hodge theory. It detects not only statistically significant attractive locations as the sinks of human trips but also significant origins as the sources of trips. As a case study, we identify the sinks and sources of commuting and shopping trips in the Tokyo metropolitan area. This aim-specific analysis leads to a combinatorial classification of city centers based on the distinct aspects of human mobility. The proposed method can be applied to other mobility datasets with relevant properties and helps us examine the complex spatial structures in contemporary metropolitan areas from the multiple perspectives of human mobility.


title: Extractors for Images of Varieties

abstract: We construct explicit deterministic extractors for polynomial images of varieties, that is, distributions sampled by applying a low-degree polynomial map $f : \mathbb{F}_q^r \to \mathbb{F}_q^n$ to an element sampled uniformly at random from a $k$-dimensional variety $V \subseteq \mathbb{F}_q^r$. This class of sources generalizes both polynomial sources, studied by Dvir, Gabizon and Wigderson (FOCS 2007, Comput. Complex. 2009), and variety sources, studied by Dvir (CCC 2009, Comput. Complex. 2012). Assuming certain natural non-degeneracy conditions on the map $f$ and the variety $V$, which in particular ensure that the source has enough min-entropy, we extract almost all the min-entropy of the distribution. Unlike the Dvir-Gabizon-Wigderson and Dvir results, our construction works over large enough finite fields of arbitrary characteristic. One key part of our construction is an improved deterministic rank extractor for varieties. As a by-product, we obtain explicit Noether normalization lemmas for affine varieties and affine algebras. Additionally, we generalize a construction of affine extractors with exponentially small error due to Bourgain, Dvir and Leeman (Comput. Complex. 2016) by extending it to all finite prime fields of quasipolynomial size.


title: The Impact of Racial Distribution in Training Data on Face Recognition Bias: A Closer Look

abstract: Face recognition algorithms, when used in the real world, can be very useful, but they can also be dangerous when biased toward certain demographics. So, it is essential to understand how these algorithms are trained and what factors affect their accuracy and fairness to build better ones. In this study, we shed some light on the effect of racial distribution in the training data on the performance of face recognition models. We conduct 16 different experiments with varying racial distributions of faces in the training data. We analyze these trained models using accuracy metrics, clustering metrics, UMAP projections, face quality, and decision thresholds. We show that a uniform distribution of races in the training datasets alone does not guarantee bias-free face recognition algorithms and how factors like face image quality play a crucial role. We also study the correlation between the clustering metrics and bias to understand whether clustering is a good indicator of bias. Finally, we introduce a metric called racial gradation to study the inter and intra race correlation in facial features and how they affect the learning ability of the face recognition models. With this study, we try to bring more understanding to an essential element of face recognition training, the data. A better understanding of the impact of training data on the bias of face recognition algorithms will aid in creating better datasets and, in turn, better face recognition systems.


title: Deep neuroevolution for limited, heterogeneous data: proof-of-concept application to Neuroblastoma brain metastasis using a small virtual pooled image collection

abstract: Artificial intelligence (AI) in radiology has made great strides in recent years, but many hurdles remain. Overfitting and lack of generalizability represent important ongoing challenges hindering accurate and dependable clinical deployment. If AI algorithms can avoid overfitting and achieve true generalizability, they can go from the research realm to the forefront of clinical work. Recently, small data AI approaches such as deep neuroevolution (DNE) have avoided overfitting small training sets. We seek to address both overfitting and generalizability by applying DNE to a virtually pooled data set consisting of images from various institutions. Our use case is classifying neuroblastoma brain metastases on MRI. Neuroblastoma is well-suited for our goals because it is a rare cancer. Hence, studying this pediatric disease requires a small data approach. As a tertiary care center, the neuroblastoma images in our local Picture Archiving and Communication System (PACS) are largely from outside institutions. These multi-institutional images provide a heterogeneous data set that can simulate real world clinical deployment. As in prior DNE work, we used a small training set, consisting of 30 normal and 30 metastasis-containing post-contrast MRI brain scans, with 37% outside images. The testing set was enriched with 83% outside images. DNE converged to a testing set accuracy of 97%. Hence, the algorithm was able to predict image class with near-perfect accuracy on a testing set that simulates real-world data. Hence, the work described here represents a considerable contribution toward clinically feasible AI.


title: Deep neuroevolution to predict primary brain tumor grade from functional MRI adjacency matrices

abstract: Whereas MRI produces anatomic information about the brain, functional MRI (fMRI) tells us about neural activity within the brain, including how various regions communicate with each other. The full chorus of conversations within the brain is summarized elegantly in the adjacency matrix. Although information-rich, adjacency matrices typically provide little in the way of intuition. Whereas trained radiologists viewing anatomic MRI can readily distinguish between different kinds of brain cancer, a similar determination using adjacency matrices would exceed any expert's grasp. Artificial intelligence (AI) in radiology usually analyzes anatomic imaging, providing assistance to radiologists. For non-intuitive data types such as adjacency matrices, AI moves beyond the role of helpful assistant, emerging as indispensible. We sought here to show that AI can learn to discern between two important brain tumor types, high-grade glioma (HGG) and low-grade glioma (LGG), based on adjacency matrices. We trained a convolutional neural networks (CNN) with the method of deep neuroevolution (DNE), because of the latter's recent promising results; DNE has produced remarkably accurate CNNs even when relying on small and noisy training sets, or performing nuanced tasks. After training on just 30 adjacency matrices, our CNN could tell HGG apart from LGG with perfect testing set accuracy. Saliency maps revealed that the network learned highly sophisticated and complex features to achieve its success. Hence, we have shown that it is possible for AI to recognize brain tumor type from functional connectivity. In future work, we will apply DNE to other noisy and somewhat cryptic forms of medical data, including further explorations with fMRI.


title: Ultra-thin Tunable Optomechanical Metalens

abstract: Reconfigurable metasurfaces offer great promises to enhance photonics technology by combining integration with improved functionalities. Recently, reconfigurability in otherwise static metasurfaces has been achieved by modifying the electric permittivity of the meta-atoms themselves or their immediate surrounding. Yet, it remains challenging to achieve significant and fast tunability without increasing bulkiness. Here, we demonstrate an ultra-thin tunable metalens whose focal distance can be changed through optomechanical control with moderate continuous wave intensities. We achieve fast focal length changes of more than 5% with response time of the order of 10$\mu$s


title: Learning Single Image Defocus Deblurring with Misaligned Training Pairs

abstract: By adopting popular pixel-wise loss, existing methods for defocus deblurring heavily rely on well aligned training image pairs. Although training pairs of ground-truth and blurry images are carefully collected, e.g., DPDD dataset, misalignment is inevitable between training pairs, making existing methods possibly suffer from deformation artifacts. In this paper, we propose a joint deblurring and reblurring learning (JDRL) framework for single image defocus deblurring with misaligned training pairs. Generally, JDRL consists of a deblurring module and a spatially invariant reblurring module, by which deblurred result can be adaptively supervised by ground-truth image to recover sharp textures while maintaining spatial consistency with the blurry image. First, in the deblurring module, a bi-directional optical flow-based deformation is introduced to tolerate spatial misalignment between deblurred and ground-truth images. Second, in the reblurring module, deblurred result is reblurred to be spatially aligned with blurry image, by predicting a set of isotropic blur kernels and weighting maps. Moreover, we establish a new single image defocus deblurring (SDD) dataset, further validating our JDRL and also benefiting future research. Our JDRL can be applied to boost defocus deblurring networks in terms of both quantitative metrics and visual quality on DPDD, RealDOF and our SDD datasets.


title: Simple initialization and parametrization of sinusoidal networks via their kernel bandwidth

abstract: Neural networks with sinusoidal activations have been proposed as an alternative to networks with traditional activation functions. Despite their promise, particularly for learning implicit models, their training behavior is not yet fully understood, leading to a number of empirical design choices that are not well justified. In this work, we first propose a simplified version of such sinusoidal neural networks, which allows both for easier practical implementation and simpler theoretical analysis. We then analyze the behavior of these networks from the neural tangent kernel perspective and demonstrate that their kernel approximates a low-pass filter with an adjustable bandwidth. Finally, we utilize these insights to inform the sinusoidal network initialization, optimizing their performance for each of a series of tasks, including learning implicit models and solving differential equations.


title: Investigating the effect of electronic correlation on transport properties and phononic states of Vanadium

abstract: In the present work, we have tried to investigate the importance of electronic correlation on transport properties and phononic states of Vanadium (V). The temperature-dependent electrical resistivity ($\rho$) and electronic part of thermal conductivity ($\kappa_e$) due to electron-electron interactions (EEIs) and electron-phonon interactions (EPIs) are computed. The values of $\rho$ due to EEIs are found to be extremely small in comparison to $\rho$ due to EPIs. For instance, at 300 K, the calculated value of $\rho$ due to EEIs (EPIs) is $\sim$ 0.859$\times10^{-3}$ ($\sim$ 0.20) $\mu\Omega$m. The magnitudes of $\kappa_e$ due to EPIs are found to be in good agreement with the experimental results. These observations indicate the negligible importance of EEIs to these quantities for V. However, at 300 K, the value of Seebeck coefficient ($S$) at DFT+DMFT level ($\sim$ -0.547 $\mu$VK$^{-1}$) is found to be entirely different than at DFT level ($\sim 7.401$ $\mu$VK$^{-1}$). Also, the DFT+DMFT value of $S$ at 300 K is in good match with the available experimental data (-1.06 $\mu$VK$^{-1}$, 1.0 $\mu$VK$^{-1}$). Apart from this, the study of phononic states at DFT and DFT+DMFT level is performed. The obtained phononic band structure and phonon DOS at DFT+DMFT differ to a good extent from that at DFT. The maximum energy of phononic state obtained at DFT (DFT+DMFT) is $\sim$ 33.83 ($\sim$ 35.15) meV, where the result of DFT+DMFT is obtained more closer to the experimental data (35.15, 36.98 & 41.77 meV). These results highlight the importance of electronic correlation on $S$ & phononic states of simple correlated V metal.


title: Predictive linguistic cues for fake news: a societal artificial intelligence problem

abstract: Media news are making a large part of public opinion and, therefore, must not be fake. News on web sites, blogs, and social media must be analyzed before being published. In this paper, we present linguistic characteristics of media news items to differentiate between fake news and real news using machine learning algorithms. Neural fake news generation, headlines created by machines, semantic incongruities in text and image captions generated by machine are other types of fake news problems. These problems use neural networks which mainly control distributional features rather than evidence. We propose applying correlation between features set and class, and correlation among the features to compute correlation attribute evaluation metric and covariance metric to compute variance of attributes over the news items. Features unique, negative, positive, and cardinal numbers with high values on the metrics are observed to provide a high area under the curve (AUC) and F1-score.


title: Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesis

abstract: We present a novel one-shot talking head synthesis method that achieves disentangled and fine-grained control over lip motion, eye gaze&blink, head pose, and emotional expression. We represent different motions via disentangled latent representations and leverage an image generator to synthesize talking heads from them. To effectively disentangle each motion factor, we propose a progressive disentangled representation learning strategy by separating the factors in a coarse-to-fine manner, where we first extract unified motion feature from the driving signal, and then isolate each fine-grained motion from the unified feature. We introduce motion-specific contrastive learning and regressing for non-emotional motions, and feature-level decorrelation and self-reconstruction for emotional expression, to fully utilize the inherent properties of each motion factor in unstructured video data to achieve disentanglement. Experiments show that our method provides high quality speech&lip-motion synchronization along with precise and disentangled control over multiple extra facial motions, which can hardly be achieved by previous methods.


title: Single-Field Model of Gravitational-Scalar Instability. II. Black Hole Formation

abstract: On the basis of the previously formulated mathematical model of a statistical system with scalar interaction of fermions and the theory of gravitational-scalar instability of a cosmological model based on a one-component statistical system of scalarly charged degenerate fermions (\MIO models), the possibility of the formation of black holes in the early Universe using the mechanism of gravitational-scalar instability, which ensures the exponential growth of perturbations. The evolution of spherical masses in the \MIO model, as well as the evolution of black holes with allowance for their evaporation, is studied. The argumentation of the possibility of the formation of black holes in the early Universe with the help of the proposed mechanism is given, and a numerical model is constructed that confirms this argumentation. The range of parameters of the \MIO model, which ensures the growth of black hole masses in the early Universe up to $10^4\div10^6 M_\odot$, is identified.


title: Lexicon-injected Semantic Parsing for Task-Oriented Dialog

abstract: Recently, semantic parsing using hierarchical representations for dialog systems has captured substantial attention. Task-Oriented Parse (TOP), a tree representation with intents and slots as labels of nested tree nodes, has been proposed for parsing user utterances. Previous TOP parsing methods are limited on tackling unseen dynamic slot values (e.g., new songs and locations added), which is an urgent matter for real dialog systems. To mitigate this issue, we first propose a novel span-splitting representation for span-based parser that outperforms existing methods. Then we present a novel lexicon-injected semantic parser, which collects slot labels of tree representation as a lexicon, and injects lexical features to the span representation of parser. An additional slot disambiguation technique is involved to remove inappropriate span match occurrences from the lexicon. Our best parser produces a new state-of-the-art result (87.62%) on the TOP dataset, and demonstrates its adaptability to frequently updated slot lexicon entries in real task-oriented dialog, with no need of retraining.


title: Joint Design of Spectrally-Constrained OFDM Sequences and Mismatch Filter With PAPR Constraint

abstract: The OFDM sequences with low correlation sidelobe level (SLCL) is desired in many 5G wireless systems. In this letter, the OFDM sequences and mismatch filter are jointly designed to achieve the SLCL under the constraints of spectra and peak to average power ratio (PAPR). Specifically, we formulate the optimization problem by maximizing the peak side lobe ratio (PSLR) of the cross-correlation between the OFDM sequences and mismatch filter, subject to several practice constraints. To solve the nonconvex problem, an efficient alternating optimization (AltOpt) algorithm is proposed. Numerical simulations are provided to demonstrate the effectiveness of the proposed algorithms.


title: Modulus of continuity of weak solutions to a class of singular elliptic equations

abstract: In this paper we study the modulus of continuity of weak solutions to a singular elliptic equation in the plane under very weak assumption on the integrability of the elliptic coefficients. Our investigation reveals that the modulus of continuity can be described by the reciprocal of the logarithmic function raised to a power. However, the power can be arbitrarily large. This is in sharp contrast with a result by J. Onninen and X. Zhong for a degenerate elliptic equation in the plane, in which the power must be suitably small.


title: Investigating nonlinearity in wall turbulence: regenerative versus parametric mechanisms

abstract: Both linear growth processes associated with non-normality of the mean flow and nonlinear interaction transferring energy among fluctuations contribute to maintaining turbulence. However, a detailed understanding of the mechanism by which they cooperate in sustaining the turbulent state is lacking. In this report, we examine the role of fluctuation-fluctuation nonlinearity by varying the magnitude of the associated term in the dynamics of Couette flow turbulence to determine how this nonlinear component helps maintain and determine the structure of the turbulent state, and particularly whether this mechanism is parametric or regenerative. Having determined that the mechanism supporting the fluctuation field in Navier-Stokes turbulence is parametric, we then study the mechanism by which the fluctuation component of turbulence is maintained by parametric growth in a time-dependent mean flow by examining the parametric growth mechanism in the frequency domain using analysis of the time-dependent resolvent.


title: Residual Pattern Learning for Pixel-wise Out-of-Distribution Detection in Semantic Segmentation

abstract: Semantic segmentation models classify pixels into a set of known (``in-distribution'') visual classes. When deployed in an open world, the reliability of these models depends on their ability not only to classify in-distribution pixels but also to detect out-of-distribution (OoD) pixels. Historically, the poor OoD detection performance of these models has motivated the design of methods based on model re-training using synthetic training images that include OoD visual objects. Although successful, these re-trained methods have two issues: 1) their in-distribution segmentation accuracy may drop during re-training, and 2) their OoD detection accuracy does not generalise well to new contexts (e.g., country surroundings) outside the training set (e.g., city surroundings). In this paper, we mitigate these issues with: (i) a new residual pattern learning (RPL) module that assists the segmentation model to detect OoD pixels without affecting the inlier segmentation performance; and (ii) a novel context-robust contrastive learning (CoroCL) that enforces RPL to robustly detect OoD pixels among various contexts. Our approach improves by around 10\% FPR and 7\% AuPRC the previous state-of-the-art in Fishyscapes, Segment-Me-If-You-Can, and RoadAnomaly datasets. Our code is available at: https://github.com/yyliu01/RPL.


title: Rethinking Alignment and Uniformity in Unsupervised Image Semantic Segmentation

abstract: Unsupervised image semantic segmentation(UISS) aims to match low-level visual features with semantic-level representations without outer supervision. In this paper, we address the critical properties from the view of feature alignments and feature uniformity for UISS models. We also make a comparison between UISS and image-wise representation learning. Based on the analysis, we argue that the existing MI-based methods in UISS suffer from representation collapse. By this, we proposed a robust network called Semantic Attention Network(SAN), in which a new module Semantic Attention(SEAT) is proposed to generate pixel-wise and semantic features dynamically. Experimental results on multiple semantic segmentation benchmarks show that our unsupervised segmentation framework specializes in catching semantic representations, which outperforms all the unpretrained and even several pretrained methods.


title: Hydration structure of diamondoids from reactive force fields

abstract: Diamondoids are promising materials for applications in catalysis and nanotechnology. Since many of their applications are in aqueous environments, to understand their function it is essential to know the structure and dynamics of the water molecules in their first hydration shells. In this study, we develop an improved reactive force field (ReaxFF) parameter set for atomistically resolved molecular dynamics simulations of hydrated diamondoids to characterize their interfacial water structure. We parameterize the force field and validate the water structure against geometry-optimized structures from density functional theory. We compare the results to water structures around diamondoids with all partial charges set to zero, and around charged smooth spheres, and find qualitatively similar water structuring in all cases. However, the response of the water molecules is most sensitive to the partial charges in the atomistically resolved diamondoids. From the systematic exclusion of atomistic detail we can draw generic conclusions about the nature of the hydrophobic effect at nanoparticle interfaces and link it to the interfacial water structure. The interactions between discrete partial charges on short length scales affect the hydration structures strongly but the hydrophobic effect seems to be stable against these short scale surface perturbations. Our methods and the workflow we present are transferable to other hydrocarbons and interfacial systems.


title: Instance-level Heterogeneous Domain Adaptation for Limited-labeled Sketch-to-Photo Retrieval

abstract: Although sketch-to-photo retrieval has a wide range of applications, it is costly to obtain paired and rich-labeled ground truth. Differently, photo retrieval data is easier to acquire. Therefore, previous works pre-train their models on rich-labeled photo retrieval data (i.e., source domain) and then fine-tune them on the limited-labeled sketch-to-photo retrieval data (i.e., target domain). However, without co-training source and target data, source domain knowledge might be forgotten during the fine-tuning process, while simply co-training them may cause negative transfer due to domain gaps. Moreover, identity label spaces of source data and target data are generally disjoint and therefore conventional category-level Domain Adaptation (DA) is not directly applicable. To address these issues, we propose an Instance-level Heterogeneous Domain Adaptation (IHDA) framework. We apply the fine-tuning strategy for identity label learning, aiming to transfer the instance-level knowledge in an inductive transfer manner. Meanwhile, labeled attributes from the source data are selected to form a shared label space for source and target domains. Guided by shared attributes, DA is utilized to bridge cross-dataset domain gaps and heterogeneous domain gaps, which transfers instance-level knowledge in a transductive transfer manner. Experiments show that our method has set a new state of the art on three sketch-to-photo image retrieval benchmarks without extra annotations, which opens the door to train more effective models on limited-labeled heterogeneous image retrieval tasks. Related codes are available at https://github.com/fandulu/IHDA.


title: A Unified Framework for Contrastive Learning from a Perspective of Affinity Matrix

abstract: In recent years, a variety of contrastive learning based unsupervised visual representation learning methods have been designed and achieved great success in many visual tasks. Generally, these methods can be roughly classified into four categories: (1) standard contrastive methods with an InfoNCE like loss, such as MoCo and SimCLR; (2) non-contrastive methods with only positive pairs, such as BYOL and SimSiam; (3) whitening regularization based methods, such as W-MSE and VICReg; and (4) consistency regularization based methods, such as CO2. In this study, we present a new unified contrastive learning representation framework (named UniCLR) suitable for all the above four kinds of methods from a novel perspective of basic affinity matrix. Moreover, three variants, i.e., SimAffinity, SimWhitening and SimTrace, are presented based on UniCLR. In addition, a simple symmetric loss, as a new consistency regularization term, is proposed based on this framework. By symmetrizing the affinity matrix, we can effectively accelerate the convergence of the training process. Extensive experiments have been conducted to show that (1) the proposed UniCLR framework can achieve superior results on par with and even be better than the state of the art, (2) the proposed symmetric loss can significantly accelerate the convergence of models, and (3) SimTrace can avoid the mode collapse problem by maximizing the trace of a whitened affinity matrix without relying on asymmetry designs or stop-gradients.


title: A Particle-based Sparse Gaussian Process Optimizer

abstract: Task learning in neural networks typically requires finding a globally optimal minimizer to a loss function objective. Conventional designs of swarm based optimization methods apply a fixed update rule, with possibly an adaptive step-size for gradient descent based optimization. While these methods gain huge success in solving different optimization problems, there are some cases where these schemes are either inefficient or suffering from local-minimum. We present a new particle-swarm-based framework utilizing Gaussian Process Regression to learn the underlying dynamical process of descent. The biggest advantage of this approach is greater exploration around the current state before deciding a descent direction. Empirical results show our approach can escape from the local minima compare with the widely-used state-of-the-art optimizers when solving non-convex optimization problems. We also test our approach under high-dimensional parameter space case, namely, image classification task.


title: Bag Film Breakup of Droplets in Uniform Airflows

abstract: We present novel numerical simulations investigating the bag breakup of liquid droplets. We first examine the viscous effect on drop deformation before the onset of bag breakup, comparing with theory and experiment. Next, a bag film forms at late time and is susceptible to spurious mesh-induced breakup in numerical simulations, which has prevented previous studies from reaching grid convergence of fragment statistics. We therefore adopt the manifold death (MD) algorithm which artificially perforates thin films once they reach a prescribed critical thickness independent of the grid size, controlled by a numerical parameter $L_{\rm sig}$. We show grid convergence of fragment statistics when utilising the MD algorithm, and analyse the fragment behaviour and bag film disintegration mechanisms including ligament breakup, node detachment and rim destabilisation. Our choice of the critical thickness parameter $L_{\rm sig}$ is limited by numerical constraints and thus has not been matched to experiment or theory; consequently, the current simulations yield critical bag film perforation thicknesses larger than experimentally observed. The influence of the MD algorithm configuration on the bag breakup phenomena and statistics will be investigated in future work. We also study the effects of moderate liquid Ohnesorge number ($0.005 \leq Oh \leq 0.05$) on the bag breakup process and fragment statistics, where a non-monotonic dependency of the average diameter of bag film fragments on $Oh$ is found. These results highlight the utility of the MD algorithm in multiphase simulations involving topological changes, and pave the way for physics-based numerical investigations into spume generation at the air-sea interface.


title: Comments on 'X-ray analysis of ZnO nanoparticles by Williamson Hall and size-strain plot methods' Solid State Sciences 13 (2011) 251-256

abstract: The equation for the size strain plot methods reported by A. Khorsand Zak et al. (Solid State Sci. 13 (2011), 251) does not follow the dimensional homogeneity, consequently leading to an inaccurate estimation of the crystallite size and strain values of the materials under investigation and the dimensions of the obtained parameters. We also perceived an error in the values of crystallite size and strain reported by the authors using the size-strain plot method. We will discuss the importance of dimensional analysis and its repercussions on the estimated values and the units of parameters.


title: Two-arc-transitive bicirculants

abstract: In this paper, we determine the class of finite 2-arc-transitive bicirculants. We show that a connected $2$-arc-transitive bicirculant is one of the following graphs: $C_{2n}$ where $n\geqslant 2$, $\K_{2n}$ where $n\geqslant 2$, $\K_{n,n}$ where $n\geqslant 3$, $ \K_{n,n}-n\K_2$ where $n\geqslant 4$, $B(\PG(d-1,q))$ and $B'(\PG(d-1,q))$ where $d\geq 3$ and $q$ is a prime power, $ X_1(4,q)$ where $q\equiv 3\pmod{4}$ is a prime power, $\K_{q+1}^{2d}$ where $q$ is an odd prime power and $d\geq 2$ dividing $q-1$, $ AT_Q(1+q,2d)$ where $d\mid q-1$ and $d\nmid \frac{1}{2}(q-1)$, $ AT_D(1+q,2d)$ where $d\mid \frac{1}{2}(q-1)$ and $d\geq 2$, $\Gamma(d, q, r)$, where $d\geq 2$, $q$ is a prime power and $r|q-1$, Petersen graph, Desargues graph, dodecahedron graph, folded $5$-cube, $X(3,2)$, $ X_2(3)$, $ AT_Q(4,12)$, $GP(12,5)$, $GP(24,5)$, $B(H(11))$, $B'(H(11))$, $ AT_D(4,6)$ and $ AT_D(5,6)$.


title: Robust One-shot Segmentation of Brain Tissues via Image-aligned Style Transformation

abstract: One-shot segmentation of brain tissues is typically a dual-model iterative learning: a registration model (reg-model) warps a carefully-labeled atlas onto unlabeled images to initialize their pseudo masks for training a segmentation model (seg-model); the seg-model revises the pseudo masks to enhance the reg-model for a better warping in the next iteration. However, there is a key weakness in such dual-model iteration that the spatial misalignment inevitably caused by the reg-model could misguide the seg-model, which makes it converge on an inferior segmentation performance eventually. In this paper, we propose a novel image-aligned style transformation to reinforce the dual-model iterative learning for robust one-shot segmentation of brain tissues. Specifically, we first utilize the reg-model to warp the atlas onto an unlabeled image, and then employ the Fourier-based amplitude exchange with perturbation to transplant the style of the unlabeled image into the aligned atlas. This allows the subsequent seg-model to learn on the aligned and style-transferred copies of the atlas instead of unlabeled images, which naturally guarantees the correct spatial correspondence of an image-mask training pair, without sacrificing the diversity of intensity patterns carried by the unlabeled images. Furthermore, we introduce a feature-aware content consistency in addition to the image-level similarity to constrain the reg-model for a promising initialization, which avoids the collapse of image-aligned style transformation in the first iteration. Experimental results on two public datasets demonstrate 1) a competitive segmentation performance of our method compared to the fully-supervised method, and 2) a superior performance over other state-of-the-art with an increase of average Dice by up to 4.67%. The source code is available at: https://github.com/JinxLv/One-shot-segmentation-via-IST.


title: Visual Fault Detection of Multi-scale Key Components in Freight Trains

abstract: Fault detection for key components in the braking system of freight trains is critical for ensuring railway transportation safety. Despite the frequently employed methods based on deep learning, these fault detectors are highly reliant on hardware resources and are complex to implement. In addition, no train fault detectors consider the drop in accuracy induced by scale variation of fault parts. This paper proposes a lightweight anchor-free framework to solve the above problems. Specifically, to reduce the amount of computation and model size, we introduce a lightweight backbone and adopt an anchor-free method for localization and regression. To improve detection accuracy for multi-scale parts, we design a feature pyramid network to generate rectangular layers of different sizes to map parts with similar aspect ratios. Experiments on four fault datasets show that our framework achieves 98.44% accuracy while the model size is only 22.5 MB, outperforming state-of-the-art detectors.


title: VR-GNN: Variational Relation Vector Graph Neural Network for Modeling both Homophily and Heterophily

abstract: Graph Neural Networks (GNNs) have achieved remarkable success in diverse real-world applications. Traditional GNNs are designed based on homophily, which leads to poor performance under heterophily scenarios. Current solutions deal with heterophily mainly by mixing high-order neighbors or passing signed messages. However, mixing high-order neighbors destroys the original graph structure and passing signed messages utilizes an inflexible message-passing mechanism, which is prone to producing unsatisfactory effects. To overcome the above problems, we propose a novel GNN model based on relation vector translation named Variational Relation Vector Graph Neural Network (VR-GNN). VR-GNN models relation generation and graph aggregation into an end-to-end model based on Variational Auto-Encoder. The encoder utilizes the structure, feature and label to generate a proper relation vector. The decoder achieves superior node representation by incorporating the relation translation into the message-passing framework. VR-GNN can fully capture the homophily and heterophily between nodes due to the great flexibility of relation translation in modeling neighbor relationships. We conduct extensive experiments on eight real-world datasets with different homophily-heterophily properties to verify the effectiveness of our model. The experimental results show that VR-GNN gains consistent and significant improvements against state-of-the-art GNN methods under heterophily, and competitive performance under homophily.


title: Thirty-three deformation classes of compact hyperk\"ahler orbifolds

abstract: As their smooth analogue the irreducible symplectic varieties appear as elementary bricks in the generalizations of the Bogomolov decomposition theorem (arXiv:math/0402243, arXiv:2012.00441). Let $S$ be a K3 surface; generalizing the Fujiki construction, we investigate the irreducible symplectic varieties with simply connected smooth locus that can be obtained as terminalizations of quotients of the product $S^{n}$. In dimension 4, we compute the singularities for 29 orbifolds examples which appear to be independent under deformation. We also provide 4 additional orbifolds examples in dimension 6.


title: Calculus rules for proximal {\epsilon}-subdifferentials and inexact proximity operators for weakly convex functions

abstract: We investigate inexact proximity operators for weakly convex functions. To this aim, we derive sum rules for proximal {\epsilon}-subdifferentials, by incorporating the moduli of weak convexity of the functions into the respective formulas. This allows us to investigate inexact proximity operators for weakly convex functions in terms of proximal {\epsilon}-subdifferentials.


title: Dynamics of interaction of topological localized structures in reversed time

abstract: The results of numerical simulation of the interaction of topological solitons (2+1)-dimensional O(3) non-linear sigma model in reversed time are presented. At the first stage, models of interactions of topological vortices are developed, where, depending on the dynamic parameters, processes of their decay into localized perturbations and phased annihilation are observed. Also, models for the phased annihilation of topological vortices during their interaction with 180-degree domain walls are considered. On the basis of the models obtained, initial conditions for numerical simulation of interaction processes in reversed time are developed. The models describing the complete restoration of the initial topological field of interacting solitons at the combination of localized perturbations and radiation waves are obtained. Also, models are obtained that describe the formation of topological vortices in the plane of the domain wall and their subsequent emission. Thus, the T-invariance property of the field-theoretic model under study is confirmed. Numerical calculations were carried out in a stratified space on the basis of methods of the theory of finite difference schemes, using the properties of a stereo-graphic projection. The experiments were carried out for different values of the Kronecker-Hopf index of topological vortices. A complex program module is proposed that implements a special algorithm for the numerical calculation of the evolution of the interaction of space-time topological structures in reversed time.


title: On sharp third Hankel determinant for certain starlike functions

abstract: In this paper, we provide an estimation for the sharp bound of the third Hankel determinant of starlike functions of order $\alpha$, where $\alpha$ ranges in the interval $[0, 1/6]\cup \{1/2\}$ and thereby extending the result of Rath et al. (Complex Anal Oper Theory: No. 65, 16(5), 8 pp 2022).


title: An optimisation-based domain-decomposition reduced order model for the incompressible Navier-Stokes equations

abstract: The aim of this work is to present a model reduction technique in the framework of optimal control problems for partial differential equations. We combine two approaches used for reducing the computational cost of the mathematical numerical models: domain-decomposition (DD) methods and reduced-order modelling (ROM). In particular, we consider an optimisation-based domain-decomposition algorithm for the parameter-dependent stationary incompressible Navier-Stokes equations. Firstly, the problem is described on the subdomains coupled at the interface and solved through an optimal control problem, which leads to the complete separation of the subdomain problems in the DD method. On top of that, a reduced model for the obtained optimal-control problem is built; the procedure is based on the Proper Orthogonal Decomposition technique and a further Galerkin projection. The presented methodology is tested on two fluid dynamics benchmarks: the stationary backward-facing step and lid-driven cavity flow. The numerical tests show a significant reduction of the computational costs in terms of both the problem dimensions and the number of optimisation iterations in the domain-decomposition algorithm.


title: Translating Solitons in Generalised Robertson-Walker Geometries

abstract: We generalise the notion of translating solitons in Generalised Robertson-Walker sapcetimes, which come equipped with a natural conformal Killing time-like vector field. We single out three one-parameter families of warping functions for which these objects exist, and we fully classify the corresponding Grim Reapers -- translation-invariant solitons -- for a large family of Riemannian fibres.


title: On the Stability and Accuracy of Clenshaw-Curtis Collocation

abstract: We study the A-stability and accuracy characteristics of Clenshaw-Curtis collocation. We present closed-form expressions to evaluate the Runge-Kutta coefficients of these methods. From the A-stability study, Clenshaw-Curtis methods are A-stable up to a high number of nodes. High accuracy is another benefit of these methods; numerical experiments demonstrate that they can match the accuracy of the Gauss-Legendre collocation, which has the optimal accuracy order of all Runge-Kutta methods.


title: Equity Promotion in Public Transportation

abstract: There are many news articles reporting the obstacles confronting poverty-stricken households in access to public transits. These barriers create a great deal of inconveniences for these impoverished families and more importantly, they contribute a lot of social inequalities. A typical approach addressing the issue is to build more transport infrastructure to offer more opportunities to access the public transits especially for those deprived communities. Examples include adding more bus lines connecting needy residents to railways systems and extending existing bus lines to areas with low socioeconomic status. Recently, a new strategy is proposed, which is to harness the ubiquitous ride-hailing services to connect disadvantaged households with the nearest public transportations. Compared with the former infrastructure-based solution, the ride-hailing-based strategy enjoys a few exclusive benefits such as higher effectiveness and more flexibility. In this paper, we propose an optimization model to study how to integrate the two approaches together for equity-promotion purposes. Specifically, we aim to design a strategy of allocating a given limited budget to different candidate programs such that the overall social equity is maximized, which is defined as the minimum covering ratio among all pre-specified protected groups of households (based on race, income, etc.). We have designed a linear-programming (LP) based rounding algorithm, which proves to achieve an optimal approximation ratio of 1-1/e. Additionally, we test our algorithm against a few baselines on real data assembled by outsourcing multiple public datasets collected in the city of Chicago. Experimental results confirm our theoretical predictions and demonstrate the effectiveness of our LP-based strategy in promoting social equity, especially when the budget is insufficient.


title: Toeplitz determinants on bounded starlike circular domain in $\mathbb{C}^n$

abstract: In this paper, we derive the sharp bounds of Toeplitz determinants for a class of holomorphic mappings on the bounded starlike circular domain $\Omega$ in $\mathbb{C}^n$, which extend certain known bounds for various subclasses of normalized analytic univalent functions in the unit disk to higher dimensions.


title: Visual Place Recognition

abstract: Visual position recognition affects the safety and accuracy of automatic driving. To accurately identify the location, this paper studies a visual place recognition algorithm based on HMM filter and HMM smoother. Firstly, we constructed the traffic situations in Canberra city. Then the mathematical models of the HMM filter and HMM smoother were performed. Finally, the vehicle position was predicted based on the algorithms. Experiment results show that HMM smoother is better than HMM filter in terms of prediction accuracy.


title: Joint Cryo-ET Alignment and Reconstruction with Neural Deformation Fields

abstract: We propose a framework to jointly determine the deformation parameters and reconstruct the unknown volume in electron cryotomography (CryoET). CryoET aims to reconstruct three-dimensional biological samples from two-dimensional projections. A major challenge is that we can only acquire projections for a limited range of tilts, and that each projection undergoes an unknown deformation during acquisition. Not accounting for these deformations results in poor reconstruction. The existing CryoET software packages attempt to align the projections, often in a workflow which uses manual feedback. Our proposed method sidesteps this inconvenience by automatically computing a set of undeformed projections while simultaneously reconstructing the unknown volume. We achieve this by learning a continuous representation of the undeformed measurements and deformation parameters. We show that our approach enables the recovery of high-frequency details that are destroyed without accounting for deformations.


title: Non-local Minami-type estimates for a class of quasi-periodic media

abstract: This paper is a follow-up of our earlier work [11] where a uniform exponential Anderson localization was proved for a class of deterministic (including quasi-periodic) Hamiltonians with the help of a variant of the KAM (Kolmogorov--Arnold--Moser) approach. Building on [11], we prove for the same class of operators a non-local variant of the Minami eigenvalue concentration estimate.


title: QCD spectral sum rules 2022

abstract: We present a compact review of the status of QCD spectral sum rules until 2022. We emphasize the recent progresses for determining the QCD input parameters ($\alpha_s$, running quark masses, quark and gluon condensates) where their correlations have been taken into account. Some selected phenomenological uses of the sum rules in different channels (light and heavy quarks, gluonia/glueballs, hybrids and four-quark states) are briefly reviewed and commented. The estimate of the $1^{-+}$ light hybrid mass is revised which confirms the hybrid nature of the $\pi_1(1600)$ but not the $\pi_1(2050)$.


title: An FMM Accelerated Poisson Solver for Complicated Geometries in the Plane using Function Extension

abstract: We describe a new, adaptive solver for the two-dimensional Poisson equation in complicated geometries. Using classical potential theory, we represent the solution as the sum of a volume potential and a double layer potential. Rather than evaluating the volume potential over the given domain, we first extend the source data to a geometrically simpler region with high order accuracy. This allows us to accelerate the evaluation of the volume potential using an efficient, geometry-unaware fast multipole-based algorithm. To impose the desired boundary condition, it remains only to solve the Laplace equation with suitably modified boundary data. This is accomplished with existing fast and accurate boundary integral methods. The novelty of our solver is the scheme used for creating the source extension, assuming it is provided on an adaptive quad-tree. For leaf boxes intersected by the boundary, we construct a universal "stencil" and require that the data be provided at the subset of those points that lie within the domain interior. This universality permits us to precompute and store an interpolation matrix which is used to extrapolate the source data to an extended set of leaf nodes with full tensor-product grids on each. We demonstrate the method's speed, robustness and high-order convergence with several examples, including domains with piecewise smooth boundaries.


title: Reconfigurable Intelligent Surface-Empowered Code Index Modulation for High-Rate SISO Systems

abstract: In this study, a novel index modulation based communication system is proposed by combining the recently popular code index modulation-spread spectrum (CIM-SS) and reconfigurable intelligent surface (RIS) techniques. This technique is called CIM-RIS in short. In this proposed system, in addition to the traditional modulated symbols, the spreading code indices also carry data by being embedded in the signal, and the reflection/scattering properties of the signals are voluntarily controlled via the RIS technique. Consequently, the proposed system consumes little energy while transmitting extra bits of information compared to the traditional RIS. Average bit-error error (ABER) analysis of the proposed system is carried out and the system complexity, energy efficiency, and throughput analyses are obtained. Performance analysis of the system is carried out on Rayleigh fading channels for the M-ary quadrature amplitude modulation (QAM) technique. It has been shown by computer simulations that the CIM-RIS scheme has better error performance, faster data transmission speed, and lower transmission energy, compared to traditional RIS, transmit spatial modulation aided RIS (TSM-RIS) and transmit quadrature spatial modulation based RIS (TQSM-RIS) techniques.


title: An Automatic SOAP Classification System Using Weakly Supervision And Transfer Learning

abstract: In this paper, we introduce a comprehensive framework for developing a machine learning-based SOAP (Subjective, Objective, Assessment, and Plan) classification system without manually SOAP annotated training data or with less manually SOAP annotated training data. The system is composed of the following two parts: 1) Data construction, 2) A neural network-based SOAP classifier, and 3) Transfer learning framework. In data construction, since a manual construction of a large size training dataset is expensive, we propose a rule-based weak labeling method utilizing the structured information of an EHR note. Then, we present a SOAP classifier composed of a pre-trained language model and bi-directional long-short term memory with conditional random field (Bi-LSTM-CRF). Finally, we propose a transfer learning framework that re-uses the trained parameters of the SOAP classifier trained with the weakly labeled dataset for datasets collected from another hospital. The proposed weakly label-based learning model successfully performed SOAP classification (89.99 F1-score) on the notes collected from the target hospital. Otherwise, in the notes collected from other hospitals and departments, the performance dramatically decreased. Meanwhile, we verified that the transfer learning framework is advantageous for inter-hospital adaptation of the model increasing the models' performance in every cases. In particular, the transfer learning approach was more efficient when the manually annotated data size was smaller. We showed that SOAP classification models trained with our weakly labeling algorithm can perform SOAP classification without manually annotated data on the EHR notes from the same hospital. The transfer learning framework helps SOAP classification model's inter-hospital migration with a minimal size of the manually annotated dataset.


title: Lexical Complexity Controlled Sentence Generation

abstract: Text generation rarely considers the control of lexical complexity, which limits its more comprehensive practical application. We introduce a novel task of lexical complexity controlled sentence generation, which aims at keywords to sentence generation with desired complexity levels. It has enormous potential in domains such as grade reading, language teaching and acquisition. The challenge of this task is to generate fluent sentences only using the words of given complexity levels. We propose a simple but effective approach for this task based on complexity embedding. Compared with potential solutions, our approach fuses the representations of the word complexity levels into the model to get better control of lexical complexity. And we demonstrate the feasibility of the approach for both training models from scratch and fine-tuning the pre-trained models. To facilitate the research, we develop two datasets in English and Chinese respectively, on which extensive experiments are conducted. Results show that our approach better controls lexical complexity and generates higher quality sentences than baseline methods.


title: RL-Based Guidance in Outpatient Hysteroscopy Training: A Feasibility Study

abstract: This work presents an RL-based agent for outpatient hysteroscopy training. Hysteroscopy is a gynecological procedure for examination of the uterine cavity. Recent advancements enabled performing this type of intervention in the outpatient setup without anaesthesia. While being beneficial to the patient, this approach introduces new challenges for clinicians, who should take additional measures to maintain the level of patient comfort and prevent tissue damage. Our prior work has presented a platform for hysteroscopic training with the focus on the passage of the cervical canal. With this work, we aim to extend the functionality of the platform by designing a subsystem that autonomously performs the task of the passage of the cervical canal. This feature can later be used as a virtual instructor to provide educational cues for trainees and assess their performance. The developed algorithm is based on the soft actor critic approach to smooth the learning curve of the agent and ensure uniform exploration of the workspace. The designed algorithm was tested against the performance of five clinicians. Overall, the algorithm demonstrated high efficiency and reliability, succeeding in 98% of trials and outperforming the expert group in three out of four measured metrics.


title: The Information Ecosystem of Conspiracy Theory: Examining the QAnon Narrative on Facebook

abstract: There has been concern about the proliferation of the "QAnon" conspiracy theory on Facebook, but little is known about how its misleading narrative propagated on the world's largest social media platform. Thus, the present research analyzed content generated by 2,813 Facebook pages and groups that contributed to promoting the conspiracy narrative between 2017 and 2020. The result demonstrated that activities of QAnon pages and groups started a significant surge months before the 2020 U.S. Presidential Election. We found that these pages and groups increasingly relied on internal sources, i.e., Facebook accounts or their content on the platform, while their dependence on external information sources decreased continuously since 2017. It was also found that QAnon posts based on the Facebook internal sources attracted significantly more shares and comments compared with other QAnon posts. These findings suggest that QAnon pages and groups increasingly isolated themselves from sources outside Facebook while having more internal interactions within the platform, and the endogenous creation and circulation of disinformation might play a significant role in boosting the influence of the misleading narrative within Facebook. The findings imply that the efforts to tackle down disinformation on social media should target not only the cross-platform infiltration of falsehood but also the intra-platform production and propagation of disinformation.


title: When Spectral Modeling Meets Convolutional Networks: A Method for Discovering Reionization-era Lensed Quasars in Multi-band Imaging Data

abstract: Over the last two decades, around 300 quasars have been discovered at $z\gtrsim6$, yet only one has identified as being strongly gravitationally lensed. We explore a new approach -- enlarging the permitted spectral parameter space, while introducing a new spatial geometry veto criterion -- which is implemented via image-based deep learning. We first apply this approach to a systematic search for reionization-era lensed quasars, using data from the Dark Energy Survey, the Visible and Infrared Survey Telescope for Astronomy Hemisphere Survey, and the Wide-field Infrared Survey Explorer.Our search method consists of two main parts: (i) the preselection of the candidates based on their spectral energy distributions (SEDs) using catalog-level photometry and (ii) relative probabilities calculation of the candidates being a lens or some contaminant, utilizing a convolutional neural network (CNN) classification. The training data sets are constructed by painting deflected point-source lights over actual galaxy images, to generate realistic galaxy-quasar lens models, optimized to find systems with small image separations, i.e., Einstein radii of $\theta_\mathrm{E} \leq 1$ arcsec. Visual inspection is then performed for sources with CNN scores of $P_\mathrm{lens} > 0.1$, which leads us to obtain 36 newly selected lens candidates, which are awaiting spectroscopic confirmation. These findings show that automated SED modeling and deep learning pipelines, supported by modest human input, are a promising route for detecting strong lenses from large catalogs that can overcome the veto limitations of primarily dropout-based SED selection approaches.

categories: astro-ph.GA astro-ph.CO astro-ph.IM cs.CV cs.LG


title: Target-Free Text-guided Image Manipulation

abstract: We tackle the problem of target-free text-guided image manipulation, which requires one to modify the input reference image based on the given text instruction, while no ground truth target image is observed during training. To address this challenging task, we propose a Cyclic-Manipulation GAN (cManiGAN) in this paper, which is able to realize where and how to edit the image regions of interest. Specifically, the image editor in cManiGAN learns to identify and complete the input image, while cross-modal interpreter and reasoner are deployed to verify the semantic correctness of the output image based on the input instruction. While the former utilizes factual/counterfactual description learning for authenticating the image semantics, the latter predicts the "undo" instruction and provides pixel-level supervision for the training of cManiGAN. With such operational cycle-consistency, our cManiGAN can be trained in the above weakly supervised setting. We conduct extensive experiments on the datasets of CLEVR and COCO, and the effectiveness and generalizability of our proposed method can be successfully verified. Project page: https://sites.google.com/view/wancyuanfan/projects/cmanigan.


title: Ensemble Multi-Quantiles: Adaptively Flexible Distribution Prediction for Uncertainty Quantification

abstract: We propose a novel, succinct, and effective approach for distribution prediction to quantify uncertainty in machine learning. It incorporates adaptively flexible distribution prediction of $\mathbb{P}(\mathbf{y}|\mathbf{X}=x)$ in regression tasks. This conditional distribution's quantiles of probability levels spreading the interval $(0,1)$ are boosted by additive models which are designed by us with intuitions and interpretability. We seek an adaptive balance between the structural integrity and the flexibility for $\mathbb{P}(\mathbf{y}|\mathbf{X}=x)$, while Gaussian assumption results in a lack of flexibility for real data and highly flexible approaches (e.g., estimating the quantiles separately without a distribution structure) inevitably have drawbacks and may not lead to good generalization. This ensemble multi-quantiles approach called EMQ proposed by us is totally data-driven, and can gradually depart from Gaussian and discover the optimal conditional distribution in the boosting. On extensive regression tasks from UCI datasets, we show that EMQ achieves state-of-the-art performance comparing to many recent uncertainty quantification methods. Visualization results further illustrate the necessity and the merits of such an ensemble model.


title: Equivalence of primitive-stable and Bowditch actions of the free group of rank two on Gromov-hyperbolic spaces

abstract: We prove that the set of Bowditch representations (introduced by Bowditch in 1998, then generalized by Tan, Wong and Zhang in 2008) and the set of primitive-stable representations (introduced by Minsky in 2013) of the free group of rank two in the isometry group of a Gromov-hyperbolic space are equal. The case of $\mathrm{PSL}(2,\mathbb{C})$-representations has already been proved by Series and independently by Lee and Xu. Our poof in this context is independent.


title: Profile-Guided Parallel Task Extraction and Execution for Domain Specific Heterogeneous SoC

abstract: In this study, we introduce a methodology for automatically transforming user applications in the radar and communication domain written in C/C++ based on dynamic profiling to a parallel representation targeted for a heterogeneous SoC. We present our approach for instrumenting the user application binary during the compilation process with barrier synchronization primitives that enable runtime system schedule and execute independent tasks concurrently over the available compute resources. We demonstrate the capabilities of our integrated compile time and runtime flow through task-level parallel and functionally correct execution of real-life applications. We perform validation of our integrated system by executing four distinct applications each carrying various degrees of task level parallelism over the Xeon-based multi-core homogeneous processor. We use the proposed compilation and code transformation methodology to re-target each application for execution on a heterogeneous SoC composed of three ARM cores and one FFT accelerator that is emulated on the Xilinx Zynq UltraScale+ platform. We demonstrate our runtime's ability to process application binary, dispatch independent tasks over the available compute resources of the emulated SoC on the Zynq FPGA based on three different scheduling heuristics. Finally we demonstrate execution of each application individually with task level parallelism on the Zynq FPGA and execution of workload scenarios composed of multiple instances of the same application as well as mixture of two distinct applications to demonstrate ability to realize both application and task level parallel execution. Our integrated approach offers a path forward for application developers to take full advantage of the target SoC without requiring users to become hardware and parallel programming experts.